WORK SAMPLING 


ROBERT E. H El LAND 
WALLACE J. RICHARDSON 

Registered Professional Engineers 


McGraw-Hill Book Company, Inc. 
New York Toronto London 
1957 



S" ?, $y 2, 

//V^ laj 


WORK SAMPLING 

Copyright © 1957 by the McGraw-Hill Book Company, Inc. Printed in the 
United States of America. All rights reserved. This book, or parts thereof, 
may not be reproduced in any form without permission of the publishers. 

Library of Congress Catalog Card Number: 56-12269 


THE MAPLE PRESS COMPANY, YORK, PA. 


Preface 


Work Sampling 1 , as it has come to be known, was used first 
by L. H. C. Tippett, the eminent British statistician, in 1935, 
when he applied statistical sampling to the problems of pre¬ 
diction of loom breakdowns in a textile mill in England. * Its 
first appearance in this country seems to have been about 
1940, when Robert Lee Morrow described the technique 
which Tippett had called “a snap reading method 55 by the 
term “ratio delay study, 55 and visualized it as a method for 
establishing delay allowances in connection with time study, f 
The technique had widely scattered trials over the war 
years, but, like statistical quality control, failed to obtain gen¬ 
eral use because some elementary knowledge of statistics and 
probability were required for its interpretation. 

G. L. Brisley, of Wolverine Tube Division of Calumet & 
Hecla Consolidated Copper Co., is generally credited with the 
origination of the expression “Work Sampling, 55 which he 
introduced in an article in Factory Management and Main¬ 
tenance in July, 1952. The term “Work Sampling 55 is a much 
better one than ratio delay study 55 because it more properly 
describes the technique, and because it removes the limita- 

*L; H. C. Tippett, “A Snap Reading Method of Making Time Studies of 
Machines and Operatives in Factory Surveys,” Journal of the British Textile Insti¬ 
tute Transactions, vol. 26, pp. 51-55, February, 1935. 

t Morrow, Robert Lee, “Ratio Delay Study,” 1940 Annual Meeting of the 
American Society of Mechanical Engineers. 
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tion of its use to delay allowances. This is fortunate because 
the use of Work Sampling for many types of quantitative 
analysis problems deserves wider adoption. 

Over the years since 1935, many articles have been written 
for periodicals in the industrial engineering, industrial man¬ 
agement, and statistical fields, but no one book has appeared 
up to this time which attempts to supply the most important 
need: basic theory and practice, in the general case. It is 
the hope of the authors that this book will fill this need. It 
is intended not only for the use of those now using Work 
Sampling but also as an instruction manual in training and 
preparation for Work Sampling. 

The authors are painfully aware that their experience, while 
it is extensive and useful, cannot begin to encompass the 
entire range of experience which other engineers and managers 
have had in the use of Work Sampling. Any book of this 
type must therefore be an attempt to fill a specific need. The 
authors hope that it will provide the base upon which to build. 

The authors wish to extend their gratitude to the many 
companies and individuals with whom they have been associ¬ 
ated in the Work Sampling studies described in this book and 
to their preceptors, their associates at Lehigh University, and 
to many former students, who have all assisted in developing 
the authors’ own understanding and appreciation of Work 
Sampling. In particular, valuable contributions to this work 
have been made by A. D. Radin and J. F. Foley, of Reming¬ 
ton Rand Division, Sperry Rand Corporation; J. M. Kalbach, 
of E. I. du Pont de Nemours & Company; John Gladson, of 
Esso Standard Oil Co.; Robert Kanter, of the United Auto 
Workers, CIO-AFL; L. E. Killian and J. W. Enterline, of 
Armstrong Cork Co.; W. S. Masland, of C. H. Masland & 
Sons; Dr. M. E. Mundel, of Marquette University Manage¬ 
ment Center; W. L. Westerman, of the U.S. Army Ordnance 
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Management Training Center; J. K. Baker and S. W. Earle 
of Union Carbide and Carbon Co.; W. C. Young, Jr., of 
Reliance Electric and Engineering Co., Inc.; Prof. G. E 
Kane, of Lehigh University; A. C. Seccia, of American Air¬ 
lines; Prof. P. J. Thorsen, of Michigan State University; 
Prof. A. B. Cummins, of Western Reserve University; and 
Kurt Salmon, of Kurt Salmon Associates, Inc. 

Robert E. Heiland 
Wallace J. Richardson 

Department of Industrial Engineering 
Lehigh University 
Bethlehem , Pennsylvania 
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What Is Work Sampling ? 


Work Sampling is a measurement technique for the quan¬ 
titative analysis, in terms of time, of the activity of men, 
machines, or of any observable state or condition of operation.’ 
Wo fk Sampling is particularly useful in the analysis of non- 
repetitive or irregularly occurring activity, where no complete 
methods and frequency description is available. It is also an 
extremely useful device with which to make an inexpensive 
ovcr-aH surve Y of office, shop, or service activity. Such a pre¬ 
liminary study can help evaluate the need for further study, 
and it may serve to establish a “bench mark” for managerial 
purposes. Because it is extremely convenient, possesses known 
reliability, and because it operates without recourse to the stop 
watch or to subjective judgments of “effort” or “performance,” 

Work Sampling seems to be assured of wide adoption in the 
future. 

A Work Sampling study consists of a large number of obser- 
vations taken at random intervals; in taking the observations 
the state or condition of the object of study is noted, and this 
state is classified into predefined categories of activity pertinent 
to the particular work situation. From the proportions of 
observations in each category, inferences are drawn concerning 
the total work activity under study. As an oversimplified 
example, if a group of maintenance men are observed to be 
waiting” m a third of the observations made of their activity, 
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we might draw the inference that better scheduling or super¬ 
vision, rather than increased crew size, represents the most 

fruitful area for improvement. 

The underlying theory of Work Sampling is that the per¬ 
centage of observations recording a man or machine as idle, 
working, or in any other condition reflects to a known degree 
of accuracy the average percentage of time actually spent in 
that state or condition. If observations are randomly distrib¬ 
uted over a sufficiently long period of time, this theory is held 
to be true, regardless of the nature of the observed activity. 
Work Sampling observations may be likened to a series of pho¬ 
tographs taken at random times, with the added advantage 
that the observer is capable of on-the-spot interpretation and 
classification of what he sees. 

Work Sampling, as the name implies, utilizes the well- 
established principle of drawing inferences and establishing 
frames of reference from a random sample of the whole. In 
this case the “whole” is the total activity of the area, persons, 
or machines observed during the entire period of time over 
which observations are made. Work Sampling is a practical 
compromise between the extremes of purely subjective opinion 
and the “certainty” of continuous observation and detailed 
study. The advantage of Work Sampling is that the taking of 
a few random observations can be done economically, usually 
as a collateral duty of supervision, while other detailed methods 
of appraisal are more expensive and may require the full-time 

services of groups of specialists. ^ 

The exact degree of reliability of a Work Sampling stu y 
can be regulated very simply by varying the number of obser¬ 
vations made. Fundamentally, the reliability required of any 
study is dependent upon the end use to which the study will 
be put.j For example, as few as four hundred observations 
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may permit inferences to be drawn concerning broad areas of 
investigation or general courses of action. On the other hand, 
in order to aid in the establishment of production standards for 
use with incentive wage payment, several thousand observa¬ 
tions may be needed. Relatively simple statistical methods of 
determining how many observations will be presented in 
later chapters of this book. The general rule is that as more 
precise information becomes necessary, more observations are 
required. 

Rssent * a ' con ditiqnqf Work Sampling is that observa¬ 
tions be taken at random. “Randomness” in the statistical 
sampling sense means the condition that any given instant of 
time has an equal likelihood of selection as the time for obser¬ 
vation as any other instant, that there is no apparent order to 
the times of observation, and thus that one time of observation 
is independent of all other times of observation. Finally, the 
entire period of time over which samples are taken must be 
subject to selection as the random times of observation are 
drawn, } If these conditions are met, and enough observations 
are taken, inferences of known reliability may be made through 
Work Sampling. There are several straightforward tests by 
which the randomness of times of observation may be verified 
or tested. If careful attention is paid to these tests, the accu¬ 
racy and reliability of Work Sampling studies can be devel¬ 
oped to within any practical limit. By “practical” is meant 
the answer, dollarwise, to the question: “How much certainty 
of results is desired for the expense involved?” 

The reason for laying such stress on randomness of obser¬ 
vation and the taking of a large enough number of observa¬ 
tions is that Work Sampling is dependent on these two factors 
for its success. Although primarily a tool of supervision and 
management, some qualified advice in statistics is necessary in 
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most cases. The previous paragraphs are intended to point 
out the particular instances in which statistical theory is a 
matter which must be given attention. 

The Place of Work Sampling in Work Measurement 

When the term “work measurement” is used in describing 
the appraisal of industrial activity in terms of time, there is 
sometimes the connotation that the expression is limited to 
stop-watch time study or to predetermined work times. How¬ 
ever, in this text work measurement will be applied to all tech¬ 
niques, however dissimilar in detail, which are used to arrive 
at a time value for the accomplishment of work. By far the 
most common applications of work measurement techniques 
are to be found in production jobs. This is true because such 
jobs must of necessity be standardized as to material, tools, and 
method in order to produce identical operations on the prod¬ 
uct. It therefore becomes a condition of work measurement 
that the exact conditions for which the standard was originally 
set be maintained throughout the usefulness of the standard. 
Brief descriptions follow of the more common techniques of 
work measurement. These are arranged in order of size of 
the elements used in measurement, in terms of time. While 
it is true that unusual work situations might result in changes 
of the relative position of the techniques listed, the order listed 
is correct for purposes of generalization. The techniques are 
as follows: 

Predetermined Human Work Times. In this technique, 
“basic” movements of hand and body members are assigned 
time values, of the order of fractions of a second, and the time 
necessary to perform a given unit of work is built up by addi¬ 
tion of these times. A very detailed methods description must 
be made in using this technique, but this is a point in its favor, 
since it calls attention automatically to the method while set- 



5 


What Is Work Sampling? 

ting the time allowed. This technique is valuable in detailed 
planning and estimating. It requires skilled personnel, and 
has found its greatest application in production shops with 
appropriate volume to justify the expense. There are many 
systems of predetermined human work times in use, none of 
which has been recognized as a standard, but most of which 
can be quite useful when properly applied. 

Stop-watch Time Study. This is the technique most used 
at present in work measurement. It has been in use in pro¬ 
duction shops for over fifty years, and is the basis for most 
industrial time standards. In this type of measurement, a 
careful methods description is made of a task, the task is sub¬ 
divided into elements for timing, an observer watches the task 
as it is performed, and notes the time taken to accomplish the 
task. The observer may then “rate” or “level” the observed 
times; this simply means that he adjusts the observed time to 
some sort of standard of performance. Sometimes this tech¬ 
nique of “rating” is quite subjective and inexact. Sometimes 
rating is not done, but rather a fixed proportion of the 
observed time is taken as standard. In any event, it is this 
aspect of stop-watch time study which is most often criticized. 
While a great deal of this criticism is justified, the hard fact 
remains that for some classes of jobs no other technique has 
proved to be as successful. Stop-watch time study requires 
skilled personnel. It is sometimes a controversial technique. 
But it is in wide use, and will be with us for a long time. 

Elemental Times or Standard Data. This technique is 
known by a variety of names, but very simply consists of the 
tabulation of elements from stop-watch time study, according 
to physical characteristics of the workpiece, and the building 
up of time standards by combining these elements. For exam¬ 
ple, if it is observed in a series of stop-watch time studies that 
a family of parts requires about the same time to be loaded into 
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a jig or fixture, this time will be used in preference to making 
detailed studies of similar parts. In using elemental times or 
standard data in this manner, less precision of result is obtained, 
but the expense of work measurement is also less. 

Historical or Statistical Data. This method of work 
measurement is widely used in those work situations where it 
is not felt that detailed studies are justified because of varia¬ 
tions in jobs received, or because the expense involved seems 
too great for the possible savings in labor and better manage¬ 
ment. Job-shop foundries, machine shops, construction com¬ 
panies, and maintenance and service activities use this tech¬ 
nique. Very simply, some physical characteristic of the 
product or job is related to the time it has taken in the past to 
do jobs with similar characteristics. Thus, in a foundry such 
standards might be based on number of molds and tonnage. 
In a machine shop, they might be based on the amount of 
metal removed by various machines, and in an office, such 
standards might be based on pages of copy typed, number of 
invoices handled, or a similar measure. There is no detailed 
methods description made, but such standards are a great deal 
better than no standards at all. Historical or statistical data 
are in wide use, but are mostly used by supervision for planning 
gross requirements and as a rough measure of performance. 
Generally, these standards are not too exact, but again those 
employing them feel that they serve the purpose. 

Self-reporting. This hardly seems an appropriate tech¬ 
nique of work measurement to be listed with stop-watch time 
study and standard data. But many situations exist where the 
individual employee’s own appraisal of the time taken or re¬ 
quired for a job is used as a standard. This is particularly true 
in office and in maintenance work. Self-reporting of time spent 
is quite useful in some cases where labor cost is minor, and 
there exists no special desire for methods improvement. 
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Subjective Over-all Evaluate. This term may be 
applied to the very common situation wherein management 
and supervision make use of past experience and tradition to 
determine employee work loads. There is no measurement, in 
the commonly accepted sense of the word. This technique is 
mentioned, however, since so often it is the point of departure 
rom which other work measurement systems are introduced. 

It is immediately apparent that there exist wide differences 
in the given work measurement techniques. These differences 
occur in the areas of detail of methods description, precision of 
result, degree of subjective judgment, timing device used, skill 
and experience of technician performing the measurement 
and cost of measurement. The reason for the differences is 
twofold, namely, differences in objectives of measurement and 
differences m the nature of the work being measured. Not 
only may the same technique be used to study different jobs, 
but the same job may be measured by different techniques.’ 
Thus, the selection of a “proper” work measurement technique 
must take into account such factors as the previous history of 
work measurement in the plant, the relative expense of each 
method, and the nature of the job itself. In a situation of this 
nature, hard and fast rules governing the use of each work 
measurement technique simply do not exist. Each manage¬ 
ment must use its own judgment in the matter. The multi¬ 
plicity of types of work measurement schemes now in use testify 
to the fact that such exercise of judgment has taken place. 
The same job may be measured by stop-watch time study in 
one plant, by predetermined human work times in another, 
and by standard data in a third. Furthermore, all three 
methods may be successful in each particular situation. The 
only conclusion which may be drawn is that many of the tech¬ 
niques of work measurement have some versatility, and that 
the conditions surrounding the use of the various techniques 
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should be considered before an attempt is made to select the 

technique. , . 

Since Work Sampling is of relatively modern ongm, how¬ 
ever, not many hard and fast rules have been developed with 
respect to the situations in which it may be applied. In some 
respects, this is a fortunate circumstance. Too many of the 
presently used techniques have had to live down a history of 
misapplication in particular factory situations before their 
merit was established under proper conditions. Work Sam¬ 
pling, however, is a self-policing technique in the sense that as 
the study progresses, it is possible to evaluate the reliability 
and validity and to determine how many observations wi e 
required to obtain any desired level of confidence in the results. 
Furthermore, the major types of activity are pretty well defined 
in the early stages, and it is left to the director of the study to 
decide at what point it becomes uneconomical to pursue fur¬ 
ther detail. Under these circumstances a recommendation to 
“try it out and see what happens” is by no means reckless or 
irresponsible. Rather, it may be a sound approach, for Work 
Sampling is a technique peculiarly adaptable to the common 
management practice of making a broad survey to establis 
over-all conditions of operation and of following this with more 
detailed studies as indicated. 

Perhaps the best way to indicate the versatility o or 
Sampling, and at the same time to point out its limitations is 
to describe some of the situations in which Work Sampling has 
been used. This will be done in Chap. 2. The advantages 
of Work Sampling over other techniques for work measure¬ 
ment will vary with the characteristic sought in measurement. 
In some cases, particularly where detailed time standards are 
needed, Work Sampling is not nearly as suitable a measure¬ 
ment tool as predetermined times or standard data. In other 
situations, where general shop or office effectiveness is to be 
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measured, Work Sampling seems to offer the best first approxi¬ 
mation to exact measurement. In many other cases, a com¬ 
bination of Work Sampling and some other technique may be 
the best means of measurement. 

Work Sampling has many attractive features as a measure¬ 
ment tool. It is relatively inexpensive to use. It produces 
results of known reliability and accuracy. It has gained wide 
acceptance among employees, both unionized and nonunion- 
ized. . And it enables management to obtain an over-all 
appraisal of operations conveniently and economically. But 
Work Sampling, to be effective, must be done properly 
Objectives must be set which are attainable through use of the 
technique. Management must lend its support to the studies, 
and must make proper use of the results. If Work Sampling 
is undertaken with the intention of “doing the job right,” how¬ 
ever, it offers unique opportunities for gain through good work 
measurement. 
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Some Examples of the Use of 
Work Sampling 


A significant aspect of the introduction of Work Sampling 
as a work measurement technique is that in a great number of 
cases Work Sampling has been used successfully m wor situ 
ations which previously had not been considered susceptible 
of any time appraisal. This acceptance of Work Sampling 
has been accelerated by the industrial trend toward mechani¬ 
zation in production and clerical work, which in turn has led 
to greater expenditures in the maintenance and service fie s. 
As a general rule, Work Sampling is a better tool for measuring 
the type of work classed as “indirect labor” than are time study 

or predetermined human work times. , 

Perhaps the best way to illustrate the manner in which Work 
Sampling has been applied is to cite some examples of its use. 
While the examples must be presented in abridged form m this 
chapter, some will be discussed in greater detail in later chap¬ 
ters The following examples have been selected to l ustrate 
the versatility of Work Sampling. It is not possible in a few 
pages to be completely definitive, but the reader should find 
at least some work situations which will enable him to estab is 
a frame of reference for his own problem. 

10 
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case example 1 : Chemical-plant Opevatioti 

A large chemical plant included a “batch process” area in 
which relatively small lots were produced. For many years 
no appraisal had been made of the work of operating wage-roll 
personnel. It had been felt that direct labor represented only 
a small part of mill cost, and that the nature of the work was 
such that measurement was impractical. However, a cost- 
reduction program had been instituted at the plant, and it was 
decided to use Work Sampling to study direct-labor operating 
personnel. 

The work was irregular in nature, and involved walking, 
attention to gages, manipulating valves, and keeping records. 
A separate maintenance group stationed a man at each oper¬ 
ating unit to perform minor repairs as necessary. The Work 
Sampling study was made of operator activity. Although the 
maintenance men were not studied at the outset, it soon 
became apparent that they were acting as relief operators a 
substantial part of the time. Line supervision knew that 
this relief occurred “occasionally,” but had no idea of the 
actual extent. Furthermore, the study revealed that 
practically no time was being spent in certain quality control 
procedures. This was undesirable. 

As a result of the study, the stand-by maintenance crew was 
curtailed. A clerk was transferred to take care of the super¬ 
visor s routine paper work, and the supervisor was then free to 
spend more time^in the unit and to provide better direction of 
operator performance. Process yield was improved and mill 
cost wa.s reduced. 

—^ case example 2: Industrial Construction 

A large construction company uses Work Sampling as the 
basic measure of over-all labor effectiveness. The work is 
typical building craft activity, dispersed over several acres and 
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many structures on any given construction site. While the 
sites vary in size, an average of four hundred employees are 
working on a site at a given time. A company “work sam¬ 
pler” is used to take observations. Most sites are unionized. 

The activity studied was grouped into three mam categories: 
useful work, work which is undesirable, and delays or activity 
other than work. Top management at the site received 
reports of these three categories. Supervision received more 
detailed reports. Trends were watched carefully, and m 
almost every case, performance improved throughout t e 1 e 

of the project. . , 

The largest benefits have come through better planning and 

labor utilization. Undesirable work, such as rework and 
materials handling, has been pinpointed, and made the subject 
of programs for improvement. Over a period of years a bank 
of information has been collected which is valuable in devel¬ 
oping cost data for estimating. Work Sampling now is 
accepted as the standard procedure for appraising site labor 
effectiveness and for labor cost control. 

CASE EXAMPLE 3: Verifying Time-study Allowances 

A medium-sized factory was engaged in the manufacture of 
metal moldings for the automotive trade. Two hundred and 
fifty unionized production workers were covered by a blanket 
allowance for tool setup and adjustment. Such an allowance 
is applied as a percentage of time added to the standard. 
Over a period of years it had become obvicfus that the time- 
study rates had “loosened.” A restudy seemed necessary, but 
it was desired to include appraisal of the allowances as well as 
verification of the balance of the time studies. All rates were 
guaranteed, and could not be changed without corresponding 
methods change. Emphasis was placed on analyzing irregular 
activity in general, and tool setup and adjustment m particular. 
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The Work Sampling study revealed that the percentage 
allowance for tool setup was quite “loose.” Of greater impor¬ 
tance, a large amount of time was found to be spent in delays 
and in waiting for work. During this time operators were 
paid average incentive wages. Corrective action was taken 
to improve production control (scheduling) and to revise 
inspection practice. The allowances were made a matter of 
negotiation within the framework of the union contract. 
Work Sampling was made a continuous program, and a Con¬ 
trol Chart technique used to help supervision control indirect- 
labor costs. 

An interesting aspect of this study was that union shop stew¬ 
ards v/ere encouraged to accompany the personnel making 
Work Sampling observations. This helped tremendously in 
gaining acceptance of the technique. 

case EXAMPLE 4: Railroad-yard Switch-engine Activity 

A railroad classification yard used three switch engines per 
shift in its operation. Capital investment in the yard was 
high, and efficiency in operation was essential to meet sched¬ 
ules. By “classification” is meant the sorting and transfer of 
freight cars from one train to make up another train. The 
yard under study had not met expectations in economy 
and efficiency. All employees were members of strong 
unions. 

A Work Sampling study was made, in which switch-engine 
activity, conditions of trains and track, and other operating 
data were observed. No change was contemplated in crew 
size or working rules as applied to personnel. 

As a result of the study, certain operating methods were 
revised, and one switch engine per shift was eliminated. 
Paper-work procedures, which the study revealed to be the 
cause of much delay, were streamlined. Operating costs were 
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reduced by removing the causes of certain delays in train 
movement. 

An important by-product of this study was the realization 
on the part of management that sampling and statistical analy¬ 
sis techniques were applicable in many other phases of their 
operations. Railroad work involves large numbers of cars, 
bills of lading, inspection reports, tickets, and control devices. 
In many cases, sampling rather than complete inspection and 
processing seemed to offer opportunities for gain. This is now 
being investigated. 

case example 5: An Office Problem 

In a central accounts payable operation for a large company 
in the chemical industry, manual methods were used to process 
invoices and produce vouchers in payment. From a number 
of management sources came opinions that this department 
could be reduced from its present 25 employees, consisting of 
clerks and typists, by a “substantial amount 55 which was esti¬ 
mated to be upwards of 10 employees, if a punched-card pro¬ 
cedure were installed. The department supervisor was 
dubious, but was unable to reach a conclusion, because he had 
very few facts at hand with which to measure the impact of 
such a change on his department operating costs and personnel 
utilization. 

Work Sampling enabled this supervisor to reach a decision. 
Results of one month of observations revealed that only 15 
of his employees would be affected by the proposed punched- 
card procedure, but that his operating budget could be reduced 
by 6 persons. 

All observations were made by the supervisor and his assist¬ 
ant. No one else entered the office to make the study. No 
disturbance of routine was encountered. 
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CASE EXAMPLE 6: A Problem in Utilization of Plant Maintenance 

Personnel 

A large company in the hard-surfaced floor-covering indus¬ 
try was contemplating a frontal attack on a major problem of 
long standing—maintenance and construction costs. In its 
largest plant, where about 650 maintenance workers were 
employed, the company placed a fine industrial engineer who 
“didn't know it couldn’t be done.” His task was to design and 
submi t a program for (1) evaluating present maintenance and 
construction effort as to effectiveness and quality of planning 
and performance; and (2) achieving, in a period of from two 
to five years, a type of planning, control, and coordination 
which would stem the continued growth in maintenance and 
construction costs which had hitherto seemed to accompany 
most process improvements. 

The initial program for accomplishing the first objective 
was spearheaded by an extensive Work Sampling program, 
with the observers being foremen and supervisors, 30 in number’ 
Each of these was trained; standard uniformly applied cate¬ 
gories were defined; and observations were recorded and 
processed on mark-sensed punched cards at the rate of about 
40,000 man-observations per month. 

After some early nonrandom influences were detected and 
removed, the Work Sampling provided an inexpensive, valid, 
and reliable estimate of time utilization. A long-range pro¬ 
gram for accomplishing the second objective—improvement— 
was then laid out, and Work Sampling was, and is yet, the 
principal device used to measure the effectiveness of the con¬ 
tinued improvements which have followed, and are yet to come. 

The most immediately obvious improvements came from 
the mere fact that supervisors and foremen took the time and 
effort to observe their own personnel objectively and made 
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methods and materials improvements on the spot, where 
obvious economies could be made! 

CASE EXAMPLE 7: A Problem in Establishing Delay Allowances for 
Wage Incentives 

In a medium-sized company in the electrical switchgear 
industry, a program for development of wage incentives to cut 
costs was initiated. The industrial engineer undertook a pro¬ 
gram based on standard data for machining operations, along 
with tool, material, and equipment standardization. 

The shop had a United Steelworkers of America (CIO) local 
union, and union acceptance of the pace rating method was 
achieved through joint union-management agreement on a 
100 per cent pace concept in a multi-image film loop. Later 
sessions brought agreement on the principle of Work Sampling 
for establishing allowances for nonrecurring delays throughout 
the shop. 

After one month of Work Sampling by foremen and time- 
study observers, the complete range of allowance values was 
established, with virtually no disagreements whatever. Both 
union and management are very well satisfied after a year of 
operating with these allowances. 

CASE example 8: A Problem in Equipment Utilization 

In a large manufacturing company in the electronics indus¬ 
try, making vacuum tubes and other components, a problem 
in availability and adequacy of “test set” equipment arose. , 
A test set is a large, complex device having an operator s 
console, mounting positions for units to be tested, and various 
banks of dials, gages, and circuitry used for inspection of fin¬ 
ished tubes and components. In some cases, a cost as high as 
$30,000 for such a test set is incurred. 

There were three test sets available, with three operators on 
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each of three shifts using them. The department supervisor 

sc r\nZi u thC aCCUmulation °f completed units at the 
ets n larger and larger amounts, and requested that a fourth 

cquired to relieve the apparent bottleneck. 

The superintendent, on the advice of a dubious staff engi- 

neer, instituted a Work Sampling study by all three shift super- 

sm J A 8 ^ tW ^ fr ° m 12 t0 15 

siiiit, at random intervals. ^ 

After one week of observations, no more samplinv „„ 
required. Analysis of the result, showed a 54 per L ,nW 
zation of the existing sets, and corrective action taken by the 
supervisors themselves increased the utilization in a period of 
two weeks to 81 per cent, more than could have been added 

V The Urt SCt at ^ PrCvi0US P ro P ort ion of utilization! 

, , a “ SWer ay m better departmental material handling 

Th^probl 3648 ' C ^° Ser su P erv ^ on > an d simplified setup routines! 
The pioblem was not one of insufficient equipment, after all! 

CASE example 9: A Problem in Crane Delays 

• A mcd * U “' slzed com Pany in the structural-steel fabricating 
industry had a large number of complaints from skilled shop 
ayout men and fitters, working under wage incentives, about 
their inability to “make the rate,” that is, earn a bonus. 

Since the complaint was a relatively new one, while the 
rates were not new, the industrial engineer instituted a W^k 
Sampling study, noting causes of delay. 

Analysis of one week’s results revealed that the real problem 
was not the rates, but an extraordinarily large proportion of 

cmnls 111 In" t Cd k 7 W f ng f ° r SCrViCe by the ° Verhead bdd ge 
• n tracking down the causes of these delays it was 

noted that the crane operators’ access to the crane cabs was 

kx.tdd «< one end of die shop; crane operate, we „ & ™ 

floor requirements a. the end of die shop „he„ the crane cab 
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access was located; crane operators and then chammen on the 
floor were absent on personal time a large portion of the time, 
making the cranes inoperative; and a volume of work was 
flowing through the shop which was considerably larger than 
that which the number of cranes provided was intended to 

ha Note that correction of the problems could now be under¬ 
taken, since the real problems had been identified objectively. 

CASE EXAMPLE 10: A Problem in Service-station Layout 

In a large oil company, a research study was undertaken to 
determine the most economical layout for a service statiom 
A team of industrial engineers was assigned the problem 
obtaining reliable data on the distribution of service-station 
personnel time, and the distribution of customer requirements 
when visiting service stations. 

Randomly selected stations were chosen, and Work Sam¬ 
pling methods were used to gather both types of data, 
engineer observing a station did not interfere with the service¬ 
men’s work in any way, and simply observed their activities 
at random intervals. He concurrently collected data on 
customers’ requirements by observing customers random y 
chosen from a table of random numbers. Peak-and-valley 
cycles in station requirements then appeared as an importan 
by-product. 

As a result of this study, the oil company developed a new, 
improved station design, and made a major overhaul of its 
station servicemen’s training program. 

CASE EXAMPLE 11: A Problem in Preparing for Integrated Data 
Processing 

A company in the textile industry undertook a program 
aimed at integrated data processing. A small-scale general- 
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purpose computer was ordered, and investigations of present 
procedures were initiated. 

Since the present tabulating department was not functioning 
satisfactorily, a Work Sampling study of equipment capacity 
and utilization was made. This disclosed that present 
punched-card equipment was doing productive work slightly 
less than 40 per cent of the time. Further Work Sampling 
study of the tabulating department personnel time utilization 
disclosed that the supervision in the department was conspicu¬ 
ously poor in quality, and that both personnel and equipment 
were being used at a relatively low level of efficiency. 

Consequently, a major program for training, retraining, 
better housekeeping, file survey, record retention, and equip¬ 
ment maintenance was carried out, and steps to improve super¬ 
vision were taken, since management considered installation 
of a computer without efficient and well-managed tabulating 
facilities unthinkable. 

Observations for these studies were made by the department 
supervisor and his assistant, whose constructive attitudes 
throughout made identification of trouble spots, and making 
of significant improvements, possible. 

CASE EXAMPLE 12: Design and Drafting Activity 

A large design organization was faced with an acute short¬ 
age of experienced engineer-designers. The organization was 
engaged in the design of petroleum and chemical plants. 
Prior to the study, the entire group had been organized on 
functional lines, and had been dispersed over a number of 
buildings. One suggestion for improvement was that com¬ 
posite groups be organized. In addition, it was felt that many 

engineers were performing work which might be done by less 
skilled personnel. 

A Work Sampling study was made in order to measure the 
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then existing situation and to help appraise the gains possible. 
Management was not commited to change the existing situ¬ 
ation. It was possible to subcontract some of the work, or to 
rely more heavily on the design sections of vendors. But in any 
event, it was desired that the facts of the situation be known. 

The study required an unusual amount of detailed obser¬ 
vation. Group supervisors acted as observers. Categories of 
activity were defined to separate skilled work from routine 
work. The results of the study indicated that positive steps 
might profitably be taken to form composite groups, rearrange 
work assignments, and improve reference and blueprint pro¬ 
cedures. The changes which were made resulted in the meet¬ 
ing of increased work load without creating an overload on the 
designer-engineers. 
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Some Theory of Sampling in General 


What We Do When We Sample 

The idea of selecting a few items from a large number of 
items,, in order to get some idea of the composition of the entire 
lot, is a very old one, probably predating recorded history. 
Indeed, virtually everything we do in our daily lives has some 
aspects of sampling in it. For example, when we buy a basket 
of peaches at a roadstand, we actually “take a chance” that 
those on top are representative of all the others we cannot see. 
When we eat a spoonful of Mother’s soup, and announce to 
her its excellence, we are drawing the inference that other 
spoonfuls to follow will be equally satisfying. If we rig up a 
rope swing on a limb of a tree for a child, and test it with adult 
weight before allowing it to carry a child, we are really sam¬ 
pling its strength by applying an overload, drawing the infer¬ 
ence on a single sample , that subsequent use by a much lower 
weight will not cause it to break. Every time we buy any¬ 
thing-—a light bulb, an automobile, a pack of cigarettes, or 
any other item~we are drawing a sample of one, and we 
expect that one item to be representative of all other similar¬ 
looking or similarly described items. If we are dissatisfied, 
our sample of one may well cause us to change brands on our 
next purchase. Note here that, where repeated purchases of 
the “same” thing are made such as the same brand of cigar¬ 
ettes, we are accumulating a comparatively large sample as 
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time goes on, and have probably not found any appreciable 
difference from pack to pack. Nevertheless, each successive 
pack is really a sample of a tremendous quantity of similar 
packs. 

It would be highly interesting, but not especially productive, 
to go on enumerating other examples of the sampling which 
we all do continually in our daily lives. It is our purpose to 
examine here the characteristics and behavior of samples, how 
we can measure and evaluate them, and how we can then use 
these measurements and evaluations to promote action and 
improvement. 

Sampling , then, is the process of drawing inferences concerning 

the characteristics of a mass of items , by examining closely the 

characteristics of a somewhat smaller number of items drawn from 

the entire mass. 

Types of Sampling Techniques 

In general, there are three common methods of drawing 
samples: 

1. Random sampling 

2. Systematic sampling 

3. Stratified or selective sampling 

While nearly all sampling uses some degree of randomness as 
a condition, it is listed separately here, since the completely 
random sample is the most commonly used in industrial 
engineering work. 

The concept of “randomness” is somewhat intuitive. Its 
precise definition is difficult, but it can be described rather 
easily as a method of drawing samples where no apparent order 
or connection between and/or among items is present. 

The conditions for randomness can be simply stated. There 
are three: 
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1. Each item selected must be completely independent of (that 
is, not connected with) any other item. 

2. Each item must have equal likelihood of being selected; i.e., 
no item should have a better opportunity to be drawn than 
any other. 

3. The characteristic (of each item) being measured or 
descri bed throughout the drawing of samples must remain the 
same; that is, an item may not change its make-up during the 
process of sampling. 

We shall return later to these necessary conditions of ran¬ 
domness. 

Systematic sampling is a method in which a regularly ordered 
interval is maintained between items chosen. For example, 
if we select a sample of records from a file cabinet, by choosing 
every tenth record, we are using systematic sampling. How¬ 
ever, if the characteristic we are analyzing bears no relation 
to its order in the file, the systematically drawn sample may in 
reality produce a randomly distributed result in the character¬ 
istic being measured. 

Selective or “ stratified 55 sampling consists of drawing a sample 
(randomly and/or systematically) from a portion or portions 
of the entire mass of items, in order to limit the number of 
items drawn. Usually there is a reason why the portion or 
portions chosen are sufficient for the objectives desired. 
Stratifying a sample may, however, lead to dangerous conclu¬ 
sions, particularly when the stratification in sampling is not 
fully appreciated. A conspicuous example of this danger 
occurred when, during the 1936 presidential campaign, the 
Literary Digest based its opinion survey on a randomly drawn 
sample of telephone subscribers, thereby failing to realize that 
the nonsubscribers might exercise a strong influence in orLe 
direction! 

These three general types of sampling methods are all com- 
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monly used, although there is more than a little failure to 
appreciate the differences in the conclusions drawn from their 
use. 

Drawing Inferences from Samples 

All sampling is performed in order to learn something. In 
industrial engineering work the objective in sampling is usually 
to estimate something, or to describe it adequately. Since sam¬ 
pling can therefore be said to lead to the making of inferences , 
it is well to stop here and consider just what an inference is, 
and the precision with which a measurement can be made 
from sampling methods. 

If it were possible to measure a characteristic to absolute pre¬ 
cision, and if all possible items containing this characteristic 
could be measured economically, a state of certainty in our 
knowledge concerning that characteristic could be obtained. 
As an example of this certainty, suppose that we have a case 
of 24 cans of tomato juice, and wish to find out the “average 
quantity contained in a can. Assuming that we could meas¬ 
ure with infinite precision, we might find it to be 8.01056 . . . 

ounces, varying among the cans from 8.0001 . . . to 8.01567 
.... Now our knowledge concerning the contents of the 
case of 24 cans is, to all intents and purposes, certainty . 

We must realize, however, that our one case may also be 
considered as one of a large number, say 10,000, of such cases 
packed in a four-week harvest season. Consequently we are 
not able to state with certainty anything about the weight of 
the cans in the other 9,999 cases. The average which we 
found, and the limits, high and low, contained in our “typical 
case may or may not be the same as we would find if we were to 
follow the same procedure through all the other cases. 

In this type of situation, we would expect that a measure¬ 
ment of a single can in our case of tomatoes would not neces- 
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sarily be the same as the average of our entire case of 24. 
Indeed, our average weight, found by adding up all the 24 
weights and dividing by 24, may not be the actual weight of 
any single can in our case! 

In the same manner, we would find that as our sample size 
increased from 1 case to 10,000 cases, our knowledge of the 
actual average weight per can would become closer and closer 
to certainty, but we would have to measure all 240,000 cans, 
or 10,000 cases, before this certainty could exist. As the size 
of the sample increases, our approach to certainty increases; 
and conversely, the smaller the sample size , the smaller the degree of 
reliability we can attach to our result This is a cardinal rule of 
sampling. 

Methods for describing the degree of uncertainty resulting 
from sample measurements are of several types. We shall 
deal with these in later chapters. The important point 
here is that a sampling technique will always provide an 
answer which must be “hedged, 55 that is, described more or 
less unprecisely, and therefore containing a risk of error of 
some magnitude. In general, the precision , i.e., nearness to cer¬ 
tainty or truth , of the estimate made from sampling depends upon the 
sample size. 

While it may appear that a “hedged” answer, such as a 
statement that “the average weight of a can is 8.01056 
ounces plus or minus 0.05652 . . . ounce,” is a rather unsatis¬ 
factory one, it is the only type which a sampling procedure call 
possibly provide. And experience discloses that this type of 
answer is preferable, since it describes its own “margin for 
error.” Many of us—too many, perhaps—are accustomed to 
thinking of measurements as certainties, when they are in fact 
only approximations. It is good scientific thinking to con¬ 
sider all measures as only approximately true. He who intends 
to use Work Sampling must realize that this technique will 
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never provide data which can be considered in any way as 
certainty! 

The real advantage in statistical “hedging” lies m the fact 
that a scientifically or mathematically determined margin for 
error is highly preferable to the bland assumption that any one 

measurement is truth itself! 

It is noteworthy that sampling techniques behave m such a 
way that the more analysis and measurement is done, the 
greater the reliability of the result; that is, in an economic 
sense you must spend more to get more. The decision to use sam¬ 
pling is, in the first place, a recognition of the fact that com¬ 
plete measurement of all items is not economical in view of the 
value of the result. We therefore must, and should, be happy 
to interpret the results in their true light a relatively inexpen¬ 
sive method of approximation, having measurable reliability! 

Whether the practitioners realize it or not, almost all work 
measurement consists in part of the utilization of the principles 
of sampling. Work situations do not remain exactly the same. 
Variability may occur in materials, tools, training, operators, 
and surrounding conditions. For economic measurement, an 
“average” set of conditions is assumed, and full use is made of 
standard data developed in similar operations. This usually 
is done with full realization that when appreciable change 
occurs, the time standard should be adjusted. A frequent 
point of controversy, obviously, is in what constitutes ‘ appre¬ 
ciable” change. 

We are not concerned directly with this problem. It is 
enough to cite its existence. The literature in stop-watch time 
study gives ample evidence that the problem is recognized. 
Precautions are given to be sure that the period of observation 
is long enough, and statistical limits are suggested. In the use 
of predetermined human work times, users are cautioned to 
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maintain uniformity of conditions of workplace, operator, and 
material. The eight-hour production study is in itself a par¬ 
tial recognition of the fact that variability exists in the work 
situation. Since it is almost impossible to include all values, 
we must in effect sample to obtain work measurement data. 

In addition to the variability of the tools and material, there 
exists another reason for the statement that we now resort to 
sampling in work measurement. This is the practice of giving 
“allowances” for irregularly occurring activity such as tool 
setting, materials handling, receiving instructions, and other 
similar activity which is difficult to allocate to any one unit of 
work or operation. Many times these allowances are deter¬ 
mined by what is in reality a sample of one. In other 
instances these are almost “negotiated” allowances. The 
basic problem is that such irregular activity by its nature can¬ 
not be scheduled, will vary from day to day and from week 
to week, and yet is difficult to measure economically with stop 
watch or predetermined human work times. No matter what 
system of work measurement exists in a shop or office, it is sug¬ 
gested that Work Sampling will be a valuable tool in estab¬ 
lishing these allowances. Economically, some sort of sam¬ 
pling seems necessary. The irregular activity is too varied 
and too unpredictable to allow use of continuous observation 
on the scale necessary. 

In cases where no time standards exist, personnel and 
machine requirements still may have been set by a form of 
sampling. For example, the supervisor may know that for 
certain peak loads a given number of employees is required. 
We all tend to remember the unusual, and particularly the 
unusual which has been unpleasant. Therefore, the tendency 
may be to staff for the peak and to forget the “usual.” It is 
suggested that Work Sampling may give a better perspective 
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to subjective judgment by forcing consideration of the entire 
cycle of activity and by analyzing this activity so that a more 
meaningful set of judgments may be made. 

No further discussion of the concept of sampling in work 
measurement need be made here. The reader has only to ask 
himself upon what basis present decisions are made in order to 
realize that a form of sampling enters into present decisions. 
This is entirely sound, because complete consideration for 
measurement may be quite uneconomical. Work Sampling 
merely systematizes certain judgments now made subjectively 
in many cases. 




Preparing for Work Sampling 

The procedure for th e takin g of a Work Sampling study 
divides itself naturally into three phases. In order to place 
the entire procedure in proper perspective, a complete outline 
follows: 

A. Preparing for Work Sampling 

1. Deciding upon the objectives of the study 

2. Establishing and recording quantitative measures of 
production with which Work Sampling results may 
be correlated 

3. Selection and training of personnel 

4. Announcing the fact that the study will be taken 

B. Performing Work Sampling 

1. Classifying into categories the activity to be studied 

2. Designing the necessary forms 

3. Developing properly randomized times of observation 

4. Observing activity and recording data 

C. Evaluating and presenting results of Work Sampling 

1. Evaluating the validity of data 

2. Evaluating the reliability of data 

3. Presenting and analyzing data 

4. Planning for future studies 

While some of the above activities are more important than 
others, all should be considered a part of any complete study. 
The balance of this chapter is concerned with the first phase. 
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Preparing for Work Sampling 

Deciding upon the Objectives of the Study. Since this 
book is intended to be used as a tool of management, there is 
no need for an extended justification of this step in the pro¬ 
cedure. The setting of objectives has always been considered 
the essential first step in any managerial activity; indeed, with¬ 
out this, true management is impossible. Work Sampling, 
however, is a relatively new technique, and in thinking of spe¬ 
cific objectives to be sought, it is well to outline first the uses 
to which Work Sampling can be put. The reader may then 
decide which particular activities in his own work situation he 
wishes to analyze by Work Sampling, and thus what his par¬ 
ticular objectives will be. 

Work Sampling is a very versatile measurement technique. 
It has the characteristic of increasing in reliability and utility 
of results as the number of observations made increases. For 
example, while it may be necessary to extend observations over 
a month to determine cyclic variations of specific activity, the 
first week’s observations alone may be used immediately to 
check over-all performance. 

A single study may thus be put to many different uses. 
Therefore, in determining the objectives of a Work Sampling 
study, a suggested list of uses may be organized in the order 
in which they become practical. Such a list of uses is as 
follows: 

Uses of Work Sampling. To Aid in Defining the Exact 
Problem. Since the possible uses of Work Sampling are pre¬ 
sented in the order in which they become practical, the first 
use is to combine categories of activity into very gross break¬ 
downs, and thus to obtain an over-all index of performance. 
After only four hundred or so readings, for example, a good 
idea may be gained of the ratio of productive to nonproductive 
observations. In order to take specific corrective action, it is 
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desirable to have more detailed information. But if, in a shop, 
out of four hundred readings we have 60 per cent classified as 
productive and 40 per cent as nonproductive, the first indi¬ 
cated problem might be to attempt to reduce nonproductive 
time by instituting better production control, better materials 
an mg, better scheduling of maintenance, and so forth. On 
other hand, if the first four hundred readings show 95 
per cent productive and 5 per cent nonproductive, a different 
problem seems to be present. Improvement probably would 
be directed toward better methods and equipment, at least if 

the shop is considered to have nonproductive time at a reason- 
able level. 

While it may be true that with only four hundred observa- 
tons we cannot have a great deal of confidence in the exact 
percentages shown, nevertheless, as a supervisor said of the 
first case study cited: “I don’t care if that 40 per cent may be 
per cent high or low. Any amount of nonproductive time 
spent that approaches 40 per cent is too much.” In this 
case, management was able almost at the outset of the study 
to work toward the correction of an unsatisfactory condition. 

Very simply, the first practical use of Work Sampling is to 
give advance notice, in general terms, of those activities which 
constitute major proportions of total activity. At the same 
time management may get an indication of those categories 
which are of relative unimportance. While it is dangerous to 
draw too many inferences from a small sample, early recog¬ 
nition of the general problem may be gained after only a few 
days observations. 

To Aid in Establishing Goals for Supervision. As a general rule 
real improvement and control require the cooperation of first- 
line supervision. As the number of observations increases, 

r :;:: fid r e is sained in the study ’ the ^p^ors 

Should be brought into the act.” If the supervisor also acts 
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as observer, this already has been done. If someone ot er 
than the supervisor acts as observer, the supervisor should be 
given the opportunity to discuss results with the proper person. 
Therefore, the supervisor should know the basis for measuring 
the performance of his department or group. 

The results of the study should be available, and every effort 
made to encourage the use of these results as a basis for cor¬ 
rective action or continued good practice. One of the big 
problems in improvement programs is to put such information 
into the hands of those who actually must use it. Work Sam¬ 
pling, as does no other measurement technique, offers t e 
advantage that the person most capable of directing improve¬ 
ment may also be the person who gathers the information. 

At the very least, the supervisor will have helped decide 
upon the categories of activity, and thus should understand 
the results. In the experience of the authors, this participation 
by supervision is a most significant advantage of the technique of Work 
Sampling. As a c'orollary to this, it is obvious that management 
must be prepared to work with the supervisors to make changes, and that 
management must be prepared to have its own preconceived notions. sub¬ 
jected to challenge! But as more observations are obtained, 
better information becomes available and a more factua 
approach is possible. 

The goals to be set generally take the form of (1) attempting 
to reduce the proportion of undesirable activity and (2) 
attempting to increase productive activity. Work Sampling 
provides the means of “keeping score” in many situations 
where detailed work measurement techniques are not effective. 
Some typical undesirable activities which may be measured 
are: waiting for work, waiting for services of all kinds, unau¬ 
thorized absence, rework or corrective work, and many others. 
Usually, when supervision knows the nature and extent of such 
work, and knows it promptly, corrective action is possible. 
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When the monthly departmental cost report reveals extra 
expense, the real causes may be “buried,” and in any event, 
it may be too late to take effective action. Most supervisors 
have sat through unproductive meetings intended to correct 
such conditions, but many of these take place weeks after the 
damage has been done, and generate more heat then light. 
With Work Sampling, it is possible to report unsatisfactory 
conditions m a factual quantitative manner and to measure 
trends of improvement. 

In some cases, it is hard to decide what constitutes a “rea¬ 
sonable” amount of undesirable activity. No shop or office 
is perfect. But if it is possible to measure such activity, and 
to record steady improvement, to set goals for supervision in 
this effort is a necessity. This is particularly true when the 
work situation is one of an indirect-labor nature, such as main¬ 
tenance, clerical, or service activity. In these fields Work 
Sampling offers much promise. In the shop, the various 
activities for which allowances are given in work measurement 
may be appraised in terms of percentages of observations, and 
these then correlated with supervisory action. 

Work Sampling provides a measurement of activity which 
can be understood by supervision, which supervision should 
have had a part in obtaining, and which gives data of known 
reliability. This should enable the supervisor to do a better 
job of supervision. At the very least, the facts should now be 
more easily available to those responsible for the performance 
being measured. 

To Determine the Nature and Extent of Cyclic or “ Peak-load” 
Variations in Observable Activity. In many cases, work measure¬ 
ment has not been done because “the work load is not con¬ 
stant,” or because “our work is not routine.” Industrial engi¬ 
neers and shop foremen realize the frequent futility of devel¬ 
oping precise time standards for job-order work. At the same 
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time, elemental time standards have the disadvantage that 
they cannot conveniently reflect variations in working condi¬ 
tions. Thus, overstaffing may occur, and real control becomes 
harder to obtain. By its very nature, however, Work Sam¬ 
pling is a technique which reflects changes in work-load and 
shop conditions. Many business and manufacturing functions 
are cyclic in nature. This condition is bound to be reflected 
in the activity of employees and equipment in these functions. 
But if the nature and extent of the variations are known, it is 

possible to attack the problem. 

In many cases, management is aware that overstaffing exists. 
But in the absence of specific knowledge, there is a natural 
reluctance to lay off personnel who may have to be rehired 
almost immediately. It is possible that already available sta¬ 
tistics will define sales fluctuations. Work Sampling should 
provide the other part of the story, namely, the effect that these 
fluctuations have upon the production and service facilities. 
In many instances, the end of the month, the end of the 
quarter, pay day, or other similar regularly occurring events 
may tend to obscure the problem of provision of proper per¬ 
sonnel. Management knows that these exist! The problem 
is to measure their effect. 

By virtue of the fact that several days or weeks may be 
required to obtain the proper number of observations, a Work 
Sampling study will almost automatically reveal and measure 
cyclic variations. Indeed, for most situations it is accepted 
practice to extend the Work Sampling over at least a month 
in order to be sure that a representative sample is obtained. 
If the cycle is known to be longer than a month, separate 
studies may be taken in busy and slack periods. It must also 
be remembered that no significant cyclic variations may actu¬ 
ally exist. In this case, obvious overstaffing will become 
apparent. In any event, the cycle, or lack of it,' should be 
defined by the study. 
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To Aid in the Economic Analysis of Equipment Needs. As more 

esteb^r erVatiOM arC 3VaiIable ’ becomes possible to 
of oh equipment usa S e and requirements. If one round 

°50 ob 10 nS ^ h ° Ur " ^ at thC Cnd ° f a —th over 

itel o^eT W °f ^ aVailaWe ° f ^ Sil * le “ ach - or 
m t 1 1 • UlPr ? Cnt n the Case of d u P p cate or similar equip- 
ment tins total will, of course, be greater. While records of 

achine utilization may exist in the production control 
epartment and elsewhere, the observed utilization is invalu¬ 
able (Incidentally, the results of the study should be corn- 

factor.) WhatCVer ° ther rCCOrdS ^ COnCernin g this 

In some applications, such as a study of a tabulating depart- 
nt, the results of a Work Sampling of equipment afone 
ithout regard to the personnel, may be of value. In other 
applications, the equipment may be observed and recorded as 

"^r bSeWing ^ Pe ° Ple ° n thC j0b ‘ Me -t.rement 

operation ^ multi Ple-niachine 

operation, and idleness because of lack of material may pro- 

v de an insight into shop operations, completely independent 

of personnel factors. By including the state or condition" 

eqmpment on the observation sheet, it is possible to add con 
siderably to the value of the study. 

While the simple proportion of time operated does not give 
a complete picture of the economics of equipment utilization 

analysed And^ ^ aVaiIable for use in ™king economic 
mef nd agam > the cyc hc nature of demands on equip- 
ment is described and measured by Work Sampling 

To Aid tn Planning Manpower Requirements. In general the 
same statements which have been made concerning the e CO 
nomic analysis of equipment needs apply also to the planning 
of manpower requirements. As the study progresses and 

Zling of Vatl0n fi lend 40 11 3 grCater dCgree of reliability, 
Planning of specific manpower requirements becomes prac- 
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tical and defensible. By this time, enough information wi 
have been accumulated to correlate measures o production 
with the personnel requirements to attain each level of pro¬ 
duction. Also, such things as irregularly occurring activi y 
and personal time will have been measured. Therefore it 
should be possible to set work loads and to develop specie 
objectives of performance. While these may not have the 
accuracy of time determinations set by more detailed methods, 
in many instances they will be more than adequate^ 

To Aid in the Measurement of Over-all Performance. While this 
use of Work Sampling is perhaps inherent m some of the uses 
previously discussed, it is important enough to merit specia 
mention. In many situations where it is not desired o 
embark upon a complete work measurement program of great 
detail, management has found that Work Sampling is a most 
convenient means of measuring the over-all performance of a 
group or activity. This generally takes the form of a Contro 
Chart type of approach in that key categories of activity 
are continuously compared to prior performance or some 
standard. Thus, changes become easy to detect, an e 
effect of particular managerial action may be measured. 

As an example of this, a large construction organization 
groups all productive work, and charts the weekly value of 
this group of categories. When significant changes occur m 
this particularly in the unfavorable direction, the matter is 
almost automatically called to management’s attention. 
Because of the reliability possible with grouping of categories, 
the measurement may be made quite sensitive. 

This characteristic of over-all measurement is unique with 
Work Sampling. While over-all appraisal is possible with 
other measurement techniques, it generally either requires 
more work or is much less exact. Work Sampling seems to 
strike just the right balance between ease of gathering infor¬ 
mation and detail of results. Even though other measure- 
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ment techniques are used, Work Sampling may be employed 
for this purpose alone, to complete and verify the measure¬ 
ment program. In addition, Work Sampling is sometimes 
employed in order to give management a frame of reference 
to aid m making decisions concerning automation in the shop 
or office, management policy in personnel administration, and 
many other matters which require knowledge of the over all 
distribution of activities of men or machines. 

T° Aid in the Determination of Time Standards and Allowances . 
This use is given last for two very strong reasons: (1) A very 
large number of readings are necessary in order to set specific 
time standards of the required precision. (2) Each time 
standard set requires a complete methods description in detail 
far greater than it may be practical to record in the typical 
Work Sampling study. 

Furthermore, it may be considered desirable to engage in 
rating or leveling each operator, and this activity introduces a 
separate, and perhaps unknown, error* into the study. 
Finally, there are other methods which may be more eco¬ 
nomical to use in the establishing of individual production 
standards. The foregoing applies to the entire process of set¬ 
ting time standards. For the limited use of checking and 
establishing allowances for personal time, handling time, tool¬ 
setting time, cleanup time, and similar broad increments of 
time standards, however, Work Sampling is a most effective 
technique. 

In establishing allowances, Work Sampling makes it pos- 
sible to determine, over a long period of time, the proportions 
of time spent in the kinds of activity for which “blanket” 
adjustments are usually made. Its use for this purpose is 
recommended. The procedure simply requires that the fac- 


* Ralph M. Barnes, and Robert B. Andrews, 
Work Measurement,” The Journal of Industrial 
November-Dccember, 1955. 


“Performance Sampling in 
Engineering , vol. VI, no. 6, 
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tors calling for an allowance be separated in the categories of 
observed activity and the results integrated with the existing 
system of setting time standards. 

The basic reason for minimizing the use of Work Sampling 
in the setting of time standards is that, in general, it is desirable 
to set such standards after the method has been improved. With 
each change of method, the observations taken under the pre¬ 
vious method may not be useful in measuring the new method. 
The improvement of method, selection of proper equipment, 
and standardization of procedures must precede the setting of 
standards. Thus in addition to the practical necessity of 
obtaining hundreds of observations of a particular job, there 
is the requirement that qualitative analysis and methods work 
be done in the proper order. It is shortsighted in the extreme 
to limit the objective of Work Sampling to the development of 
time standards of a detailed nature. It is most practical to 
use Work Sampling as a measuring tool for grosser activity 
categories, and to integrate this with more traditional meas¬ 
ures of production, such as pieces per hour or tons per 
day. 

When allowances are set by Work Sampling, they prob- 
ably will not be as detailed in nature as those set by stop-watch 
time study or predetermined human work times. On the 
other hand, Work Sampling forces consideration of variations 
in materials, services, and working conditions. For that rea¬ 
son, allowances set by Work Sampling should reflect “typical” 
conditions, and should be more defensible for that reason. 
One of the weaknesses of standard setting by short studies is 
that the final standard either does not reflect variability in 
job conditions or depends upon some sampling technique to 
supply a measure of such variability. 

Special Uses of Work Sampling. The preceding list of uses of 
Work Sampling is intended to serve as a guide to initial 
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studies. Also, their arrangement stresses the point that the 
end use of results depends upon the objectives sought and on 
the number of observations taken. As the user becomes more 
proficent and gains more confidence in the technique, he will 
see the possibilities for further applications. 

Some specific examples of further uses of Work Sampling 
are as follows: 6 

1. To help establish job content, as an aid to job evaluation. 
The procedure here is to define Work Sampling categories of 
activity m such a way that they are compatible with classifi¬ 
cations m the job evaluation plan: Then the Work Sampling 
results will enable inferences to be drawn concerning the pro¬ 
portions of time spent under certain working conditions, exer¬ 
cising certain degrees of skill, or assuming certain responsi- 
i ities. These may be compared with the job descriptions as 
an aid in the administration of the job evaluation plan. 

. To help supervisors organize their time. This is simi!*,- 

JT! Ceding USC t ^ le job of the supervisor may be 

studied directly or the relationship of time spent by the 

supervisors with their men may be studied. Then the time 
istnbution may be examined objectively to see where the 
supervisor needs help. For example, the common supervisory 
complaint of “too much paper work” can be evaluated. 

3. Appraisal of safety performance. Most accidents are 
preventable. This prevention takes the form of periodic 
inspections, plus vigilance on the part of supervision. Work 
Sampling can be used to supplement safety inspections by the 

use of special codes to indicate “hazardous or unsafe working 
conditions. 55 6 

4. Appraisal of shop effectiveness or efficiency. A Work 
Sampling study in itself gives some measure of shop efficiency 
However, if additional subjective judgments are made to sup¬ 
plement the more objective categorizations, a great deal more 
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can be learned. While this does not mean that trained time- 
study raters are necessary, it is possible to get a better idea of 
the general level of shop performance. For instance, co es 
may be established to classify further the initial observations 
such as “working” or “handling materials.” Such codes 
might require subjective judgments as to whether or not a job 
is “overmanned,” whether work is done “in accordance with 
standard shop practice,” or whether observed activity is 

“ineffective” or not. . , 

Since such classification is subjective in nature, it should no 
override the basic activity categorization. Also, the observer 
should be qualified to make the judgments involved. Here 
the advantage of having supervisors act as observers is readily 


apparent. A7 , 

5. Observance of specific management policy. Where 

management policies concern shop or office activity suitab e 
for analysis by Work Sampling, the technique may be profit¬ 
ably employed to appraise the effect of such policy or the 
degree to which management directives are being followed. 
Specifically, such matters as whether or not highly skilled he p 
performs unskilled jobs, whether machines and tools are being 
operated in accordance with desired practice, and many 
aspects of attendance and personal convenience may be 

appraised in terms of time. . 

This list could be extended almost indefinitely. e specia 
applications usually are the outgrowth of initial studies of a 
straightforward and conventional nature. Once Work Sam¬ 
pling has been established in a company, it will find many 
applications unique to that company. In general, its econ¬ 
omy and the fact that the Control Chart technique provides 
a sensitive measure of improvement or change have resulted 
in a wide variety of special uses of Work Sampling. The 
authors are confident that the future will bring many more. 
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Summary. The preceding uses of Work Sampling are ex¬ 
pressed in broad terms. This is done in order that, in the set¬ 
ting of objectives of Work Sampling studies, the uses may serve 
as suggestions and as a guide, rather than as a “cookbook 5 ’ set 
of rules. Each situation in which the ...technique is applied is 
different. However, those applying Work Sampling are 
much better situated than anyone else to appraise their own 
individual needs. In addition, those on the scene must live 
with the results , and should choose objectives which are prac¬ 
tical to the particular activity to be studied. The uses given 
include those most commonly sought, and will serve as a guide 
to the statement of objective. 

Establishing and Recording Quantitative Measures of 
Production with Which Work Sampling Results May Be 
Correlated. Prior to the actual taking of observations in a 
Work Sampling study, it is wise to agree upon some quanti¬ 
tative measures of output or production which may be corre¬ 
lated with the observed activity. Such measures of output are 
almost essential, as they contribute to the study in the following 
respects: 

1 „ They establish an important part of the working condi¬ 
tions for a particular study. 

2„ They establish a means of correlating observable activity 
with recorded production. This is invaluable in planning 
personnel and machine requirements and for setting standards. 

3. They may help answer the question: “Was the period of 
time over which Work Sampling was done representative of 
entire operations? 55 

In most cases, no new records need be kept. It may be 
necessary to segregate and preserve some records which other¬ 
wise might be destroyed, but this is not usual. The following 
are examples of the type of record used for the purpose under 
discussion: 
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Measure of Production Situation under Study 

Earned man-hours of production. Manufacturing department activity 

Tons of steel fabricated. Structural steel shop 

Number and type of tickets issued.. . . Airline passenger reservation procedure 

Number of orders filled. Stock-picking and shipping room 

Dollar volume of business. Retail-store sales departments 

Number of invoices received. Accounts payable office 

Units of production. Machine-shop activity 

The people supervising the study must decide upon the par¬ 
ticular measure or measures which are most meaningful and 
which can be obtained most economically. In most cases, 
this should result in no additional expense, because some sort 
of production record is kept in most businesses. It also is 
desirable to record any unusual conditions or circumstances, 
in order to be able to analyze the results of the study and to 
be able to have more confidence in these results. 

All this should be made a matter of discussion before the 
study starts, and a clear agreement should be reached that the 
records chosen are pertinent to the activity being measured. 
If there exists any doubt as to whether or not the records 
chosen are meaningful, it is well to keep several records and 
to choose among them after the results of the study are avail¬ 
able. Usually it is difficult to go back and reconstruct records. 
As a by-product of the study, consideration of the reliability 
of such records as an indicator of manpower and machine 
requirements may be very profitable. 

Selection and Training of Personnel. There are, in 
general, five groups of people involved in a Work Sampling 
study. Not all these groups are selected; some already hold 
the organizational position outlined. But all groups must be 
considered, since all really participate in the study. 

The groups considered are as follows: 

1. Management 

2. Director of the study (technical advisor) 
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3. Line supervision 
4- The observer or observers 
5. The personnel being studied 
Management. The „r 

bas; ic decisions involved These“ t0 ^ 
to make the study, the selection 

and the determination of the objectives of the r ^ r™’ 

eral, the study requires strnno- f * StUdy ' In gen ' 

agement should make a cle management support. Man- 
Sampling as a tool in W °* 

« ^::;r rz r wi,toK - 

Management should set un th~ ^ 
the progress of the study. It should^ f ° ^ rCP ° rtS ° f 
these results and, if necessary to p P re P are d to accept 

r -—»“ 

of support necessary ensure .. j ‘ P ™ C ‘ *8™« 

Properly, and that cooperation is obta' lt!eIf “ ““ d ' 

Ttis —“ 

the!,udp ‘” 

2. To be responsible for proper reporting of 

observers 000 ^ 110 ” ^ managernent , to select and train 

cate g ol C s 0 ofacS^ With SUPCrViSOrS "* ° bs ™> «° define 
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5 ; To 0«8" data .obola,ion and process 
% resins,hie *» “ 

Tt d 6 «»->.»>*"-°“ ibk ,or ,he “ ,hod ‘ 

conduct o£ the study industrial engi¬ 
ne director pj-ooeduves group, or from a 

neenng section, ro gince Work Sampling ts a fairly 

:Z"';r„seZmayn„,hauehadpr.io«s 

the person selected shew personable> and painstaking 

and supervision, t a. ’ grasp of high school mathe- 

* inquired, 

matics. No ““ft Z be desirable. There mem to 
although this would, of cour , ^ In brief, the 

be no rigid requirements o forin and who has an 

job requires a person who gets things 

open mind. 1H rpceive some training in statistics. The 

^ devoted to .ha, -«« - “ 

L,n, T ;'' Zpr^Ue infomadon L necemary 

not also act as observ , he should a i d in estab- 

to the observers and director. , ^ ^ st udy to his 

lishing the objectives an s ou authority and 

personnel. I, must be kept £•£££ infenmed of 

ZZdZZdZ^d tha, changes „ b. made 

results, and he snorn the study. 

m „ depend upon the «tob, ty worth ot a „ y 

n Otarrir «, 0te ”' e Z opon the validity and reli- 

...corit of measurement depenas p 
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ability of the basic data. In the case of Work Sampling these 

record”,hlbL“ tia Th b T ati "r “ "" 

_ . . X C 0Dserver - Therefore, unless the observers are 

conscientious and well instructed in ^ 

_i. instructed m their duties, Work Sam- 

Plmg cannot succeed. Conversely, . group J 
emDlo° mPetent ° bSerVerS Can contr it>ute tremendously to 

T,h'“b' ° f WOrt “ 

eaiization of the objectives of any study 

clr;r ,y ; ,h ' fmah ° ° f ** °»»™-»<» vi,„,„ y , 

cond d„ n f™’' and reCO,<i ™“'“»«s «. or 
, C " h P ' r, °" » r '“'hine under study, To do 

mav ^ ™ ,h h « H' 

may be ,o move around in the area understudy He 

certainly will be required to exercise his judgment He must 

be conscientious and without bias in the taking of observations 

na y, e should have an understanding of the method 
ology and objectives of Work Sampling 

entatbvT”” 8 ” * h " -’PP 11 " 1 =><»« in i S 

nhrety by the present employee, ta the area, be „„ dicd 
It is much simpler and more logical to take * 
know, the shop, office, or other activity under JZZZZt 

't:e““ k b s “ p,,ns z: 

S tLT“ , e -. p ' r ” nnd " dcan -C 

g • hey know the equipment and are qualified to recog- 
nize unusual conditions. Furthermore the rw-t, ^ 

or be given ttme familiar^ himself with Three ge'l” 

types of observers may be used. These are: 

1. Methods and measurement personnel, already engaged 
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in work measurement activity. This type of observer may 
already be engaged in time study or methods work m the ar 
under study. Such a person is a trained man, accustome 
recognling detail and to the classification of work acPvity mto 
categories. Depending on the previous history of the actions 
of his group, he may have a good degree of acceptance. Such 
observers are most commonly used m areas sue as mac me 
shops, tabulating equipment installations, and m 
in which they would perform work measuremen y 
other than Work Sampling. This last is the stgmfican 
requirement. If a time-study man normally would be 
assigned to an area, he should make an effective observer, 
time-study men are not normally in a given area, they prob¬ 
ably will be regarded as “outsiders” and might take a long 
time in gaining acceptance. 

2 Specially trained observers, hired for the purpose, or 
transferred into a full-time job as such. This type is almost 
an extension of the previous type. In some fields, such as com 
struction and maintenance work, several 

and the work is done over wide geographical areas. Y 

Z custom to these c«. «o employ a “work -ampler,” "to* 
task is to move around almost constantly, making observa io 
as he goes. In some maintenance operations he is able to 
make only four or five rounds a day because of the wide dis¬ 
persion of people under study. Because of the craft nature o 
maintenance and construction work, it is sometimes desirable 
to use such a work sampler because immediate supervision may 
be oriented too much toward certain craft-union philosophies 
which make unbiased observation hard to obtain, 
perhaps a special case, but it exists in some situations 

3. Line supervision. Where at all possible, .* » r*m- 
mended that the first-line supervisors and their assistants act as o 
or least assist i» the taking of observattons. Whde ttos » 
create a small demand on the supervisors' time, the benefits 
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by far outweigh the disadvantages. Unless management is 
definitely dissatisfied with a supervisor’s performance and does 
not trust him, there is no reason why he cannot be an observer. 
If the supervisor is too busy in scheduled meetings, etc., he 
may take part of the observations, and his assistant may help. 
Even if someone else is observer the supervisor should be 
encouraged to take a check study (with fewer observations, 
perhaps) in order to understand the technique better. 

A common frequency of observations is eight per day. 
Many line supervisors make that many “rounds” a day in the 
normal course of events. In many office situations, the super¬ 
visor need not leave his desk to take observations. The 
authors have had many successful experiences in having super¬ 
visors take observations. To the objection that supervisors 
may try to influence the results favorably to themselves, the 
authors have found that this has happened only infrequently 
and has been easy to detect when it did happen, and that this 
risk is offset by the fact that the supervisor is quite familiar 
with the work, and will have tremendous confidence in the 
results. 

As an observer, the supervisor will be able to know and 
explain details of the study to his people. There is no better 
way to help the supervisor get a measure of his own area’s 
activity. It is axiomatic in management that operational 
information is most useful when it is available immediately at the point 
of corrective action. This is exactly the situation when the super¬ 
visor takes the observations. In cases where no measurement 
has been done before, such as in many office and service-type 
activities, the supervisor is most emphatically the logical one 
to act as observer. 

Training of Observers. In discussing the training of observers, 
the assumption is made that the observer is familiar with the 
operations to be studied and is capable of recognizing activity 
by category and the personnel by name. The subject matter 



48 


Work Sampling 


with which the observers are to be familiarized, therefore, will 
consist principally of techniques. The following topics should 
be covered: 

1. Discussion of theory of sampling and the law of large 
numbers. Practically speaking, the objective here is to give 
a simple explanation of sampling. 

2. Discussion of the definition of categories. This is self- 
explanatory. Training here should include joint trips through 
the area to be studied, and comparison of results. 

3. Instruction in the use of the observation form. 

4. Discussion of randomization of times of observations. 

5. Discussion of the objectives and end uses of the study. 

A full discussion of all subject matter would be repetitious. 
The important thing to remember is that the director of the 
study, the observers, and management should all understand 
the part to be played by each. Since the observer’s main 
contribution should be to gather accurate and reliable data, 
he should be trained primarily for this. The director is prob¬ 
ably the most logical one to serve as instructor. In addition 
to the advantage of reducing the possibility of misunderstand¬ 
ings arising, this arrangement will allow the director to become 
acquainted with the observers, and them with him. 

Training of observers should require no more than four or 
five hours at the outset. It should be scheduled as any other 
meeting, and there should be a clear indication that manage¬ 
ment considers the training to be important. 

The Personnel Being Studied. Everyone to be studied should 
be told about the study. He should be asked to work nor¬ 
mally, and should be promised that the results, in an abridged 
form, will be made public in the area. This abridgment 
should be carefully done from the personnel relations point of 
view. But all questions should be answered. 

Announcing the Fact That the Study Will Be Taken. 
In announcing the study to the personnel to be observed, good 
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personnel relations should be kept in mind. There should be 
nc.misunderstanding and suspicion arising from secret or sur- 
ptitious studies. This does not mean that the observer 

should be preceded by a brass band, but it does mean that each 

employee shofa, feel fa, „ofa„ g « being ^ ^ ^ 

Some managements have made the mistake of shrouding in 
mystery efforts in work analysis or work measurement ^ 
has only to consider this attitude from the point of view of the observed 
ployee to realize how unsound it is! Work Sampling, when 

rZl K " 311 °^ CtiVe teCh ^ ^noum 

its effecd P T 38 SUCh ’ th6re iS CVer y Possibility of 
ive use. It must be remembered that office and shop 

mployees have m the past sometimes been the victims of 
poorly conceived and fundamentally unsound work measure¬ 
ment schemes. It is of the utmost importance that Work 

!r Thop g mtr0d Tt aS * aCtUalIy and «* what office 

correct ****?** br ° adcasts * *> be, in the absence of 
correct information. 

It is desirable, therefore, that management should present 

program in a logical, considered manner. There is no 
satisfactory alternative to this. 

To summarize, the ultimate success of Work Sampling 
depends upon the extent to which preparatory steps have been 
thought through » and upon the foresight of Inagement 
and the director. Not all the preliminary steps are of equal 
importance. Personnel, tradition, and type of work situation 
make rigid rules hard to formulate. But there should be a 
clear statement of objectives, satisfactory measures of produc¬ 
tion should be established, personnel should be carefully 
-lecKd and fa feeIing! , hose [o ^ ob ^»V 

Aould be considered. If fa foundation is ,„„„d, fa s tudy 

results TnTh' t0 W ke i; ^ ^ Pr0du “ Satisfa «ory 

• In this, Work Sampling is no different from other 
managerial activity. 
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In the performance of the data-gathering function m Work 
Sampling, there are several clear-cut steps to be followed. 
Keeping in mind the fact that each study will be different in 
some details, these steps are as follows. 


Performing Work Sampling 

1. Classifying, into categories the activity to be studied 
2 Designing the necessary forms 

3. Developing properly randomized times of observation 

4. Observing activity and recording data 

The first three steps are joint activities among t e irec or 
and the observers. The last is the responsibility of the 

^C^IFYING INTO CATEGORIES THE ACTIVITY TO Be STUDIED 
The mechanics of Work Sampling require that the observer 
gather data by observing the state or condition of the object 
or person being studied, classify this into one of sever* cate¬ 
gories of activity, and record the observation by writing 
designated number or letter which represents that catego y. 
Since the initial classification of activity governs the utility of 
the study, it follows that definition of categories should be do 
with care. A category may be defined as a group of simi 
activities or a specific type of activity which may be recognized 
by sight and may be considered homogeneous for purposes of 
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^~ ,ore r* *• ~ 

tomer, showing merchand^^ ** - 

attention to a snerifie * , 4 ’ devoting full 

objective of the study. ' he detai118 indicated by the 

In general, the following rules should be observed in it, 
classification of activity into categories: ^ 

2. Categories should be ranaKl. ~r 
observation. P f reco £ nitl °n by visual 

obS, e ,2 e „:rr„;r °r° ri ^ 

e TOP ,i„: „ d „ trrr or dist r d ,n -b* «* 

»ado„,,« 

observer first ma kes the general , 

“writing”) and then * § categorization (such as 

n-ore 

in most cases but hi. Procedure is not necessary 

ost cases, but has been used successfully 

A Categories m nst be chosen in the lirfit of the k- • 
and end uses of the study. g 6 ° bjeCtlves 

n.«tTre P ™ !",r WhiCh “ “ <“™«Xo •» 
“*■ " ctad ' 





Work Sampling 

~ -^tss^SS 

rir=irrs»---- 

” 0 :' Categories short,ei be se, acted to ** »' 

already existing f“™dmation accepted and 

It there already etost tic0 ,arly if there are 

well-understood classes o . advantage of these, 

records to support want t0 sepa rate day work 

For instance, we wou of work are part of the 

and incentive work, if th YP ^ ^ & ^ on tVie 

shop wage-payment plan. m _ Accounting codes, 

sis 

?£££’ SSl dte number - no, aliow as great 

detail, but it has the following advantages. 

The study wiU he et«ier » take ^ , ince 

■— - —^ 

“ss b“X“ 

d,a ” S ' d h a^htperathtg' machine” into flte two separate cate- 
gory such as operati g ;; “rework operation. 

gorie. of "0''*’°"'" ^'“ ”! , |ial the greatest possible 
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30 

though, after a few days of trial observations, the categories 
need some redefinition. At this point, they can be fairly w 
finabzed and kept stable throughout the study 

To summarize, the following rules must be kept in mind in 
the selection of categories: 

1. Establish the categories with care. 

2. Define categories in writing, after discussion. 

3. Visual recognition of each activity is necessary. 

• Do not lose sight of the over-all objective of the study 
Dk„ g Necessary Form, In the development of 
he forms to be used in recording observations, and in the 
analysis of data, the analyst should set an example in 
orm design; good practice should be observed in spacing let^ 
tering, margins, and paper size. ;f he procedure for collect ng 
and interpreting data should be as simple as possible, and dl 
ns and written instructions should be clear and concise " - 

following^rfrequhed” 18 ^ ^ CXISt ’ ^ “ geHera1 ’ the 

1. Written definitions of categories 

2. Written procedure, including procedures for obtaining 

randomized times taming 

3. Observation forms for recording original observations 

4. Summary sheets for original data 

5. Other graphic means of presenting data 

are comidmd indivi ' i “ ,iy in 
at *^1“'"” 0/a,U “ r “‘- ^ lh ” H >* 

aj:,r s Te"::t* e 

min . • , ^ . Se 0f obser ver s judgment should be 

to obsp 26 ’ T 1CS ° f 411686 definitions s hould be distributed 
rvers, and elsewhere as necessary. As the study pro- 
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iLs, i. -y be «”“V » ch»ge bright ««*»£; 

TOen to b done, »U concerned must be g.ven the re™ 
Times- Tbi. should be a specific, step-bytef procedure 


Date_ 


Observer 


Activity Key 

1. Operating and running 5. Testing 

| 2. Operating and not running 6. Available 

| 3. Correcting 7. Not available (miotononco) 

t. SMlzing 8. Not available (CPC) 



Flo . 5-1. IBM machine-time sampling sheet, general tabulating department. 

the observers and others directly concerned with the study. It 
should be available for the initial training. Theprocedure 
randomizing times (to be discussed later) should be mcluded 

Observation Forms for Recording Original 0tero " U the 
particular objectives of the study, the degree of deml the 
number of categories, and the number of men ^chine ^ 
conditions to be observed all govern the actual design 
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This is relatively a simple used , is shown 

vation card, together wi , se Q f m ark-sensed 

in Fig. 5-3. How- 

cards and business m f ir , sta il a tions exist, and 

ever, only a relatively small f rental of the 

Work Sampling alone proba y«o J t is already 

necessary equipment. But / * C ^ ^ 

installed, it most certainly should b p___, 


ffTHWA X- 






lilt i!***l» 11 
111! 11 t 1 






tSifey 


9 9LXJ1-1 

3(39)1®C 






Fig. 5-3. Mark-sensed observation card. 


become necessary in a or As is the case with 

handling an inordinate amou be designed to give 

any consolidation o a , . , A . at expense of detail. 

, clear presentation of es»«ral « shown in 

“ for 

Fig . 5-4 »*» f “ hand all i, desired are cnnru- 

plotting. If on t a form s UC h as Fig. 5-5 

lative dollars spent for e forms may be set up to 

would be suitable. The summary fen* J e of personne l, 

classify observations by fe type ^° “ One fern may be used 
area of the shop, or m y office, and another 

^^^^inaf”^^,, U i, in dd. 




Annual cost, dollars 
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summarization process, incidentally, that the advantages of 
mark-sensed cards and machine processing become most 

aP afar Graphic Means of Presenting Results of Work Sampling 
Into this classification of forms falls whatever charts or graphs 
the analyst cares to make in order to present to management 
the results of Work Sampling. These might take the form of 
running graphs of the most significant activity category, bar 
, ootixntxr from office to office or shop to shop, or 


20,000i 


15,000! 


g 10,000 


< 5,0 0C 


80,000- 




I Secretary 4 Invoice 
1 Stenographer clerks 
I Teletype i Checker 
operotor 


3 Customer 5 Stock 
correspondence record 
clerks clerks 

i File clerk 


Fto. 5-6. 


Order and billing department Work Sampling summary. 


many other standard graphic techniques. Figure 5-6 is an 
example of such graphic presentation. 

Developing Properly Randomized Times of bserva- 
tion. Randomness of observation times is essential. Die 
end result of a Work Sampling study is a series of percentages 
of observations in each category of activity. The extent to 
which these percentages may differ from “actual is deter¬ 
mined by two basic sources of error. These are: 

1. Systematic error 

2. Random error 

A systematic error may occur, for example, in the case of a 
machine which has a cycle which begins every hour on the 
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, 5? 

minutes^ UWork2ZZ n or rateS for 40 

sampling observations always were taken 
recorded^ ^ h ° Ur ’ ^ machine would always be 

Si "‘ arl '’' if lay. 

be recorded as * e maCWne WouId aIwa 7 s 

. operating. I n both instances a svste 

made error is induced K„ i„„i e , ’ a s y ste ‘ 

Hnn „ o- , d by 1 k of randomization of observa- 

r;.-- ^ 

“ an —~~ 

r 

LL” p Jty “ * red ““ d «. <ta 

rpi 8 P by takm & a large number of observation* 
The chapters discussing statistics contain procedu!7 

pnate for measuring this error. It is sufficient to stateThat 

:- 

are obtained. UCCd SS m ° re obse rvations 

td ?,*': i0 “ p ”“ d “ re - - <*»' 

scope of tae T “ “> 

sidered - *. * - 

ticularly important when staggered shifts are the “ “ ^ 

It must be done in all cases. practlce ' 

2- Decide upon the number of observations per day (or 



Work Sampling 


60 

other period). Will eight otarvation. per d «’ 

Should the observer make rounds contmuously. 

decision be made to take 50 

Generali, speaking, a round ot*«".«»"£■ 

once an hour should not be onerous for 

here the director - - “ is 

»°„r™do™ ir day may be made. In some 
u^dely dispersed activities taking ™"l"“ e r 

travel, and lewer - b— 

^:itU:h=.oh,v«oLver.m,eeigh, 

rounds of observations a day. DuPont 

T C Cooke of the Engineering Department of E.Ldu Pont 

the time required to make rouuu 
explained in the following memorandum: 

TO; J. M. KALBACH, JR. 

FROM: I'sn' CLERICAL MEASUREMENT 65021 

subject: ^-CLERICA ng _ tme tq mare study 

We have developed a means of thh 

predict accurately the number 

the following: . . 

(«) The number of: observation^l" rV ed at each location 

(b) The number of operators to be 

A) The distance between observation locations 

(. i ) The number of observations at ^observation at 

With the above information the time to make 

a given location will be: 
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.1 + .005Z) 4 * .04 N 

where: D = Distance in feet walked to observation point 

N - Number of operators observed at the observation 
point 

rnf,!n? Xa 7 1 '; the dai!y ° bserver time for 3 work sam pbng study 

could be calculated as follows.* 

Study Data 

(a) Number of observation locations 

(b) Number of operators observed at each location 


- 4 


N 1 - 15 
N 2 = 10 
m = i6 

r*- IWa 9 

(c) Distance between observation locations: 

-Dl = 60 ft. 
-02 = 30 ft. 
-03 = 50 ft. 
D4 = 80 ft 

( d ) Number of daily observations at each location = 32 
Normal Minutes of Observer’s Time per Day 

32( 1 + .005 XD1 + .04 X iVl) = 32.0 minutes 

32( 1 + .005 X -02 + .04 X N2) = 20.8 minutes 

32(1 + .005 XZ>3 + .04 X .V3) = 31.7 minutes 

32(.l + .005 X D4 + .04 X -V4) = 27.5 minutes 

Total 112.0 minutes 

This technique has been used to determine the number of observers 
required, and the demands made upon their time. 


3. Within the limits previously established, select at random 
the times 0 f observation. This can be done in accordance 
with instructions in Chap. 8. 

. 4 0bsf - rv ™g Activity and Recording Data. In observ¬ 
ing the activity under study, and recording the results, the 
only general rule to follow is “Be careful.” The observations 
form the source information of the study, and every effort 
must be made to avoid systematic error. While the procedure 
itself is quite simple, the observer should be careful to: 



62 


Work Sampling 


1. Make observations at the proper times 

2. Avoid any biasing habit patterns in making observations 

3. Explicitly, not attempt to anticipate any particular 
action, but rather to record what he sees at the given instant 
of observation 

In a shop or office, for example, the observer might have to 
make his study in a large area. He should be careful not to 
follow the same route in each round of observations. This 
precaution helps avoid possible error in the event some 
employees resent the study, and “look busy” when the obser¬ 
vation is made. As the observer takes visual notice of each 
person or machine, he should make proper notation of its 
state or condition at that instant of time. Depending on shop 
conditions it may be decided to use as the time of observation 
the instant the observer first sees each worker or machine, 
the instant the observer passes the machine or workplace, or 
some other definable time. But the observer should keep 
in mind the concept that Work Sampling may be likened to 
a series of photographs, and make his observations accordingly. 

If the area to be covered is relatively small, and the activity 
may be recognized from the observer’s desk, he may not have 
to leave his desk or normal work station. This is particularly 
true in some cases where the supervisor may act as the 
observer. 

Make Observations at the Proper Times. The principle of ran¬ 
domization already has been discussed. In most cases, a logi¬ 
cal method of ensuring randomness is to follow exactly the 
schedule of times for observation developed using tables of 
random numbers, chips, or some other device. At first, this 
will probably prove to be a burden, and will result m a little 
“clock watching.” But after a short while most observers 
gain the knack of adhering to schedule. One observer used 
a wrist-watch alarm to remind himself of the time. Another 
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deactivated the loud bell of an alarm clock and stuck to his 
schedule using the clock. 

If observations are not made on schedule, they still may be 
random. There are methods of testing this condition. In 
any event, the actual time of observation should be noted. It 

is better to make a round of observations late or early than to 
omit the round. 

Avoid Any Biasing Habit Patterns in Making Observations. This 
caution applies not only to the route the observer follows, but 
also to any other habit, such as stopping at the same place each 
round for conversation or to check in, which might give undue 
advance notice of his observation. Or, if he passes a work 
station more than once, he may vary the part of the round at 
which he makes his observation. 

Explicitly , Not Attempt to Anticipate Any Particular Action , hut 
Rather to Record What He Sees at the Given Instant of Observation. 
In other words, the observer should not attempt to “second 
guess” the table of random times. If, for example, the 
machine observed is now operating, it should be so categorized, 
even though the observer knows that within a short time it 
will be idle. If enough observations are taken, the proportion 
of observations in each category will reflect the true propor¬ 
tion. Randomness of times of observation and the taking of 
large numbers of observations are the means of protecting the 
worth of the study. The observer should follow the rules; if 
he does, the results will be satisfactory. The observer should 
not impose his own opinion on the results, but should con¬ 
centrate on gathering basic data of the greatest reliability. 

In addition to the above precautions, there exist many spe¬ 
cial circumstances in the making of observations. For exam¬ 
ple, in certain cases it may be considered necessary to obtain 
more detailed information than it is possible to gain by a quick 
glance. In such cases, the general category of activity may 
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be established by a first observation; the observer may then 
go to the workplace under study and obtain the more detailed 
information. An example of this occurred in a study made of 
drafting activity. The observer (who was a supervisor) made 
his observation and classified individual activities into general 
categories such as “drawing,” “checking blueprints,” etc. 
The observer then walked around to the individual workplaces 
and inquired as to the specific nature of the work, that is, 
which projects and what type of print was being worked on. 
The observer then completed his recording of the observation. 

This method of dividing the round of observations into two 
parts was most satisfactory in the particular case mentioned. 
The draftsmen knew that their activity had been classified into 
general categories; that is, the basic type of activity had 
already been recorded. All that was left for the observer to 
do as he visited each workplace was to identify the specific 
type of print or problem on which the man was working. 
Therefore, there was no resentment, and in fact, both the 
observer and the draftsmen volunteered the opinion that the 
study was of great benefit because it provided a natural means 
of instituting discussion of the work. Previously, the drafts¬ 
men had hesitated to “bother” the supervisor with small prob¬ 
lems, and the supervisor had felt that he did not want to seem 
to be “checking up” on performance. 

This same technique of establishing the general category on 
an initial observation, then following with a more detailed 
observation, also may be useful in the office. The basis for 
following this procedure is that it is not necessary to question 
each employee; only certain categories are involved. Also, 
there will be no urgency to move along to complete the round 
of observations, and a better personal relationship should 
result. Finally, the study should be less subject to error 
arising from the giving of advance notice of observation. 
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i. ,f^ her K,““ ,i0 " W “ Ch !0mMi “ ! “*» <• '•'“•her „ not 

(or fcveSri' “,n “ ,he ' i “' StU ‘ ly “““S” ° f ">«»S 
“ratine” n “I - f techni q ue ° f Work Sampling. By 
rating or levelmg” is meant the relating of an observed 

the °r a r t0 r SOrt ° f “ Standard ” of performance. As 

e h beral use Qf quotat . on ind . ca th . s 

of some controversy in the practice of time study. RatingTa 

1“;:^ part ° f m ° st meth ° ds ^ - dy :w 

ever, and is widely practiced. As an examnle , u ■ 
stuped might be rated at 120 per cent effectiveness, aVthf 

the T mUltiPliCd ^ L2 ° t0 arrive at the time allowed 
that the obs Tf ^ ^ ad J ustment would be 

% r y to~: e r f 6 standard — 

similar expression of standard existed in thepTant" ^pur" 
pose of the introduction of this adjustment is to allow for differ- 

is he dlS 7t° n ° f the meritS and Ievels of reliability of rating 
s beyond the scope of this book. It is sufficient to say that 

the practice is quite widespread, and undoubtedly will Jdst 

Work slmphn ^ deSired ‘° inStitute 

Gomhe * f “ a SUpp emCntar y technique to time study 
omberg and Mundelf have written excellent critiques of 

wotIs! U 7 ratmg ’ ThC rCader iS enCOUraged t0 refer to these 

mu^be' clT T ifcantfeatUreS ofratin g> however, which 

***** - with Work 

A S sX?ch^:;i^ ade Uni ° n AnalySiS -Mr.- Science Research 

edl ^e^InJ^ew^ S SR™** - « 
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Rating U subject to The acceptable tout of .to 

error usually is fixed at plus or minus 10 per cent P 

cent of the ratings made. . 

2. Almost all rating procedures require careful descnptmn 

of the nature of the job and of its surrounding <&*** 

Keeping these two features m mind, t e cone usi 
reached that errors of rating and the normal errors of Wo 
Sampling will be hard to separate and analyze if rating is on 
dX observation. At the very least, an unknown will be 
introduced, and at worst, all the ills which may have^crued 
to a time-study system will be carried over to Work Sampling. 

silc rating is - activity -A** “ 

the feature of ease of observation which normally is associate 
with Work Sampling will be lost. The 

not recommend that rating be done as part of aWorkSampli g 

St K it is desired to perform time-study rating while making the 
observations in Work Sampling, be careful to maintain t 
SnTl proportions observed in the study, and to avoid adju^- 
ing Lt proportion of observations in the “working’ eate¬ 
ries. In <Lr words, rating may be used in whatever way 
seems consistent with the existing time-study plan but th 
basic data should be available, and should be used m 
original concept of proportions of the number of ^vatm^. 
The mathematics of Work Sampling are not designed to 
include percentage adjustments based on subjective judg¬ 
ments by the observer. If management feels that such ratings 
might help in some type of appraisal of shop activity, t ey may 
be included. But this should be done with cautfon^ and w^ 
the knowledge that there is being imposed on the Work Sam 
pling study an additional technique for which Work Samp mg 

^ Theterrhowever, certain circumstances in which per- 
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s“g. ThL m aS: be dODe in COnjUnCtion Work 

2 wn! eXiSt ' in u the Sh0p a hlghJ y product mix. 

arecalhl T ™ that is ’ men who 

are capable of consistent and accurate rating. 

3. The principle of rating is acceptable to employees 

Under these conditions, Work Sampling and rating may be 

combined. However certain ,, 5 y 

, . , ’ certam of the advantages of Work Sam- 

P g are thereby lost. Barnes* describes the technique he 

suggests using in such situations. 


nr* Ralph M ' Barnes Robert B. 
Work Measurement,” The Journal of 
November-December, 1955. 


Andrews, “Performance Sampling in 
Industrial Engineering, „ vol. VI, no. 6, 
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Statistics-the Science of Distribution 

Statistics has been defined by Wiener* and others as “the 
science of distribution.” By “distribution is meant the 
behavior of data phenomena according to repeal pattern. 
The use of statistics, that is, the group of mathematical an 
philosophical tools collectively known as “statistics, requires 
that the practitioner be keenly aware that it provides only 
tools of analysis: »»», not ends. The historical development 
of these tools, until recently, has been almost entirely the 
medical, biological, and agricultural research areas an 
unfortunately much of the literature of instruction is slanted 

almost exclusively in these fields. 

In the past thirty years, the extremely rapid growth of the 
statistical quality control field in industrial engineering has 
done much to open areas to statistics which had ^herto been 
closed. Minds trained in engineering have been exposed, m 
many companies, to the advantages of some of these statistical 
took The'future of industrial engineering seems unquestion¬ 
ably to involve a tremendous expansion in the use and appre¬ 
ciation of these statistical tools. For this reason much that 
follows is intended to lay a foundation for sampling m many 
other ways than Work Sampling, because the whole 

* Norbert Wiener, “The Human Use of Human Beings,” Doubleday & 
Company, Inc., New York, 1954. 
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The Law of Averages 

v*ct:“ :z l s/ir™ ^ 

will be a useful measur^^t^^ ^ ^ ^ “’“P 1 ® 

But as we have seen the re i* C characteris tic desired. 
approximation of a true measummTnT foTe'^ Z^ “ 
the sampler is convinced, or should he ^ u ^ ° f mind ’ 
the danger of error in the result by careful sel T minimi2e 

measurement, and correct interpretation r r ”’ P"*^ 
the law of averages should protect him. ' ” VemaCular > 

simply implfes tLf mlirofT ^ * 

lt > W ° uld Produce measurements IitthTd-ff 

sample, because extreme values would tend to f T‘, ° Ur 

Statisticians express this law of averages li t ^ *** 
phenomena: a & es as two separate 

1- The law of large numbers 

2- The normal curve of error 

The Law of Large Numbers 

*-? ^^ 

” ^ hl ' “ be ““gMrtr™?'’ 

*<« wi " sh °» —** 

against measurement. P rec f uenc y of occurrence 
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, t _f the “frequency distribution of 

Here we have t e con d;stribution is nothing more 

measurements. A q r measure ments, and is 

than an expression This concept changes somewhat 

usually a graphic por ray data, called “attri- 

wh en we deal with the ye-^ ” we may find that 

butes .” For example m estmg g „ test , because 

either they light or they do not, this i an 

it consigns results dosdy this “yes-or-no” type 

o^^hlopposed to the more finely measurable one, 

*e candlepower of light, wou)d b . «ro, where we 

we wished. One sue me , fs 0 t foot-candle 

tod ..light being emit ed. to0 .10foot- 

measurements to , ** -to »e are 

candle as one group, ^ of measur ement precision 

actually compromising ^ since everything varies 

which is possible. precision greater than 0.1. 

and we may hav ^ 1; ht bu ibs which are all different 

Note t hat we ha k ab;1 , t ° tQ emitU ght, and have grouped 
from each other l together. In so doing we have 

approximately sum ar ^ . mutually exclusive group- 

set up discrete categon ( ’ lues whic h will be con- 

ings, each group con ^^ ' s of measurement. We 

sidered as the same va 0 J cwilnutm distribution 

have therefore changed what is really 

into a discrete one.* and arr ange 

Wien „e d»« » ““■“'V* distribution, 

the values obtaine into su , grasped better br 

. t*. .t. t srss.r.« i"-« -f 

use of time as a ™ ri f ^ analysis into seconds, minutes, hours, etc., 

«*—^ d “ ions - 
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, d “r r “ d "*» * - Z 

we « dX ™ ' n ° mb ' rS ™p,y «. ™ .ha, if 

»»«u„ch,„ g ” 8 g ” X" *» «* 

»e wi,, find XjcXtwti^If” °“ r 
although neeessarily , mal , X eS “' ia " y 

•vl'ri' ” " iIy ,hai "' hat r - -*« <" - 

eery gross sires of categories IX™" " aIly "P 

tion, we shall find essentiallv rh § ’ thc Same co ' ld '- 

that now we shall a' ’ <S>tril,ution, except 

on»ge numbers ■rpto'^ST* ^ ““ 

crete ind MribuM * d ”‘ 

meats (sometimes called “variables”) S n ° Ve T ! mea!ur '' 
samples of 1,000 light hnlhc r Suppose that we take 5 

Whs and /erfjf, 77 T'™ 8 

two: ^ est * ^ ur categories are 

*• A bulb emits light. 

2. A bulb does not emit light 

'“l 5 T ta ' We “s'" find «» «-» given in Tab, 

' "" ,,te 5 «“P<e* uf >, 000 ,L, and 1 

_ Table 6-1 


Sample No. 


Total. 


Good 

1 Defective 

980 

20 

987 

| 13 

985 I 

15 

990 

10 

988 J 

12 

3ioj 

1 


% Defective 



77™- » 

ay md distributions such as those 
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Sample 

No. 


Table 6-2 
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Cell Interval 


fo.i 

to 

5.0 

5 
8 

6 
8 
5 


5.1 

to 


0 

10 

12 

6 

18 


10.1 

to 

15.0 

15.1 

to 

20.0 

20.1 

to 

25.0 

25.1 

to 

30.0 

30.1 

to 

35.0 

35.1 

to 

40.0 

65 

82 

76 

69 

78 

40.1 

to 

45.0 

S 

21 

20 

25 

17 

22 

105 

36 

' 43 1 
39 
42 
23 

183 

143 
' 180 
120 
135 
173 

246 

199 

221 

264 

207 

454 

414 

441 

417 

424 

10 

31 
45 

32 
38 

1,000 

1,000 

1,000 

1,000 

1,000 

751 

1,137 

2,150 370 156 

5,000 


The law of large numbers has been reflected in both the 

e. 1 classifications. Wi,^ 

each senes of sample value., we see approximately ^ 

•hape. of distribution i„ comparing d,. five sampL. 

The Normal Curve of Error 

The normal curve of error, which is the other type of form 
w ich the law of averages assumes, refers to the shape of a well- 
known frequency distribution to which nearly all of us have 
been exposed at one time or another. Its derivation* is ^ 

exploration. ^ aPPhCati ° n and use are vwy worthy of 

During the development of much of the science of statistics 
experimenters and researchers have found many natural phe! 
nomena winch appear to distribute themselves according to a 
aw of large numbers pattern which is symmetrical around a 
^ « m ° de 't This common distribution cZe is 

“Engineering T *' W ' Burr > 

Inc., New York, 1953 . ’ McGraw-Hill Book Company, 

frjutfy m ° de ’' iS that Value in 3 fre< ) uenc y distribution which occurs men 
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Lher characterized by having it* >ve»g=, « mean, value 

X— Lt: Cnis:««^ 

• + #=. Thp normal curve has been a grea 

which occur m nature. The . r 

aid in the grew* ot our knowledge of the .c.ence ot *, 

Z _ me normal curve establishes precise measuremenO 



tor the proportion ot sample values which he between any 
value »d L center or mean, or between any » -» 
along the range of possible values occumng in measuring. 

By inspection of the normal curve picture (above) 
seen tot the two “tails” ot the distribution do no. much < 
axis, o, line, along which to values are locato/n 
the curve extends in both directions indefinitely, never touching, t 

. A “median” is the center, or middle value, if all items in the distribution 

ar VTreTol^rufl7i 5 t0 thu!said to be “asymptotic to zero,” extending from 

— 00 tO + 00 • 
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Sz :r* a - « 

C C ,»7ta * n °™ Cmt '““ y “ “ »>^ m „ icaI 

a ®..i>.ica, dilution ^ ■"** •> 

a 7™' P r; c r cept ' h<> "™-* » 

io genera] characteristics , re ,„,„ IC , V ! and 

distributions which are not 7 ? “"™"i to a p ply to 

to it I, has b«lTh7 y d “ a PP™^”a,io„, 

rente of '"77“'”™“' ° f ,h ' “«»» *« the occur- 

rm in “ 

industrial engineering work. * encountered in 

The normal curve is extremely useful h™ 
representative shaoe fnr =. rt- Z * however > not as a 

- to. 

^TT “" ,he ™ 

f accessi;c4trn~ni 0 r~°“ 

ing mass of data. unchang- 

o*^ STfor'hcir'°“ Sh “ h!1 «.t and 
ability of the averages a H USe 0n tWs remarka ble 

randomly "T **-wn 

tribute themselves approxi^iy 8 ^^^/^ 

«ca»„ (in , chapter) „ ^ h<,V ' 

of error" “ d “ h “ *“ "®nal'c„„e 

perates. Returning to our Work Q flmn r 

T ” e find ““ a ^ 

to be *» -~ cal , 

Cn t W measurement scale - S ’ Zer °’ measurement at the modal 

Nostrand Company, Inc., Prii^to^JV™! °9^ tanufactured Product,” D. Van ' 
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• « Wn sav Writing and Other, would yield the 
categories into say Wr g rounds, or 

results shown m Table 6-3, being Ms 

cycles, of observations of 30 people. After 50 eye , 

auency distribution of the number of observations of Write per 

cycle Lid wear a, in Fi 6 . 6-3. The 

._ ^ Write oer cycle was 9.84, or . P 



the sample of 30. The most frequently occmruig nurnber was 
10 or 33 3 per cent, while the median value is also 10, in 
eating a very striking similarity to the normal^curvs, » *e 
mean, median, and mode. There is a single mode, and a clos 

symmetry, also found in the normal curve. 

One more characteristic of the normal curve must be exam- 
ined however, before proceeding. The mean me lan 
mode are all measures of central tendency i*., die centro^ f 
the distribution; some measure of the dtspernon of the 
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Cycle 

No. 


Table 6-3 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 


No. of 

Observations 
Recorded 
as Write 


8 

11 

10 

6 

13 
11 

7 
10 

9 

14 
4 

10 

8 
10 
11 
10 
12 

13 
9 
6 

11 

7 

11 

14 
9 


No. of 

Observations 
Recorded 
as Other 


22 

19 

20 
24 
17 

19 
23 

20 
21 
16 
26 
20 
22 
20 

19 

20 
18 
17 
21 
24 
19 
23 
19 
16 
21 


Cycle 

No. 


No. of 

Observations 
Recorded 
as Write 


26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 


10 

12 

10 

9 

12 

10 

5 

7 
10 
13 
10 

8 
15 
10 

9 

10 

8 

13 

9 

12 

9 

6 

11 

10 

10 


No. of 

Observations 
Recorded 
as Other 


20 

18 

20 

21 

18 

20 

25 

23 

20 

17 

20 

22 

15 

20 

21 

20 

22 

17 
21 

18 
21 
24 

19 

20 
20 


viduals .'ound the me,„. nrtian . modal va , ue ^ ^ ^ 

norma curve demands a certain “spread” of items 
around a center value. 

Several measures of dispersion are described in textbooks in 

222 sTrrr: which is in widest ^ - £2 

, s the standard deviation, or root-mean-square devia¬ 
tion, usual y symbolized by the lower-case Greek letter sigma, 

° , ^ 7 eaSUre 1S derived ^ finding how far each item 

the distribution departs from the mean value, and then 

squaring this deviation; these squared deviation; are sum- 
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mated, then divided by the number of items, and, finally, the 
square root is extracted. The value obtained by summating 
these squared deviations and dividing by the number of items 
u “w fhc “variance,” unrall, called r* or V, and the square 
root of the variance, * or cr, is the standard deviation. 

The standard deviation of the normal curve, when laid off 
on either or both sides of the mean, encloses known portions 
of the “area” under the curve bounded by any two values 
expressed in standard deviations, plus or minus m respect to 
the mean. These areas are direct expressions of the propor¬ 
tions of items in any normal distribution wnchshould e 
found between these points. Shown as Appendix 3 is a Tab e 
of Areas under the Normal Curve, where these areas 
expressed as between two points measured m standard devia- 

tions above or below the mean. 

Statisticians are accustomed, in this country, to using even 
numbers ot sigm» «• quick reference points for testing »», 

observed distribution for normality. In the norma cur , 

area enclosed between +l<r and -Iff is • P er c ® n ’ 
between +2cr and -2<r lies 95.45 per cent, and between +3, 
and —3<r lies 99.73 per cent. Additional increments m <r add 
very little to this area. The standard deviation computation 
for our 50 sample values is shown in Table 6-4. 

While this simple comparison shows a strong tendency of the 
observed data to be “normal” in so far as spread, or dispersion 
is concerned, more powerful tests are shown in any standard 
text in statistics, to determine whether a distribution is rea y 
“normal.” From these 50 samples of 30 each, we have 
arranged the averages of samples into a distribution which is 
approximately normal. Shewhart demonstrated this nomud 
curve shape in the distribution of averages of samples from 
very nonnormal masses of data. Even from triangular and 
rectangular distributions of individual items, when samples are 
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M ea „ = t - ™ = 9.84 


Standard deviation = r ^ = Vs/rf 2 /272.72 

“V ^ V^o~ 


V5A544 


X±U = 

X±2cr = 
-■? i 3(r = 


9-84 ± 2.335 = 
9.84 ± 2(2.335) 
9-84 ± 3(2.335) 


7.505 to 12.175, or 8 to 12 
= 5.170 to 14.510, or 6 to 14 
— 2.835 to 16.845, or 3 to 16 


2.335 



Per Cent of Area between 
--— 

1 Normal Curve 

Observed Distribution 

% ± la 

X ± 2<r 
% ± 3<r 

68.26 

95.45 

99.73 

70.00 

94.00 

100.00 
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drawn randomly from an unchanging 0* »' 

these samples will them»=lves be a normal curve, enabling us 
to use the normal curve statistics to advantage, regardless o 
the shape of the particular distribution from which the samp es 

are drawn. , 

The normal curve of error, then, shows us that so long as the 

sample values are drawn randomly and the mass oftndmduals 
remains unchanged , extreme fluctuations caused by the vagaries 
of sampling will tend to cancel each other out. Thus the law 

averages holds. , 

It would follow as a corollary, however, that if ( ) samp e 
are not drawn randomly, and/or (2) the composition of the 
mass changes , during sampling, that the distribution of sample 
averages will not be normal, and, of course, extreme va u 
will not cancel each other out, and the law of averages will not 

be true! 

Using the Normal Curve of Error in Work Sampling 

The principal use of the normal curve in Work Sampling, as 
in Control Charting, lies in its value as a method for defining 
the limits within which successive sample proportions drawn 
from the same distribution should fall, using a probability level 

chosen by the user. , . 

In the next chapter, we shall examine another basic mat - 

matical tool which utilizes the normal curve concepts in its 
application. 



7 

7Yie Binomial Theorem _- 

Basic Analysis Tool in Work Sampling 

Introduction 

In order to use Work Sampling proncrlv t . 
inferences from samples correctly, it is necessary to hare some 

The Additive Nature of Probability 

*e outcome of a flip of a coin; the various P of 

event can happen are known in advance. Se £ 

com may result, for instance, in one of three things ^1? 
1. The com may come to rest head up, tail down. g ‘ 

' The com may come to rest tail up, head down. 

The' factTr ma \ COme *° rCSt ° n ed S e > “either face up. 
e fact that no other result may happen leads to the state 

ment that we have defined all the ways in which the event may 

certainty ^ e ^ ^ SUmmation of thc three ways as 

h-tarnty, t,., we are certain that one of these three events will 

This total probability is always defined as unity, or 1.000. 

81 
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The probability that either event 1, 2, or 3 will h ^PP 
expressed as a proportion of unity, or something less than 
1 000 . . , and is usually expressed as a decimal amount, 

l.UUU ...» 1 /A 1 /2 etc The summation 

e.g., 0.50, or as a fraction, 1/4 or 1/2, etc. in 

of these individual probabilities is unity, or 1.000. 

our cota mppbg, fo, have 

of each of the three events exposed as, say. 0.49 , • 

and 0 0002, totaling 1.000. 

L a bridge game, the probability of being dealt any one 
Z be considered as one in fifty--., as.um.ng a the 
ough shuffle and straight deal. Thu, the probabihtyof draw- 
Z » ace of spades is 1/52, or ».01«077, etc. The p»l> 

ability is the same for each other card. 

In Work Sampling, the probability of occurrence. of each 

category can be expensed a. a fracuon or pn.port.on these 
amounts totaling 1.000. In the example t«d; 
the probability of observing an indnodual person Wnnng 

apparently about 9.84/30, or 32.8 per cent, or 0.328 of 
appa / i r n /s7? • these two totaling 

the Other category, therefore, 0.672, these tw 

1.000. 

The Compounding Nature of Probability 

If the probability of one event (.) is 1/2 or 0.50, and of 
another ( ) is also 1 /2, 0.50, and there is no other way m which 
21 event may happen, the probability of event « oceurri j 
twice in succession under conditions where the probabilities 
remain constant, and the events occur under conditions 

random sampling, is 1/2 X 1/2, or 0.50 X °' 50 ’ ° r / ’ 

0 25 Similarly, the probability of the same event on time 
U./5. oiuu y, r or i/g i n other 

successive occurrences is 1/ X / > times in sue- 

words, the probability of one result occurr.ug . h™ ” “ 

cestion is it. probability raised « *= »* P°»»' “ “ “ 

some example, of this mukipltariive or compouudmg effect, 
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where probabilities remain constant, and random choices are 
mam tamed. 

In a coin-tossing experiment, assuming the probability of 
a head or a carl each equal to 1/2 (i.e„ ignoring the possibility 
of its coming to rest on its edge), the probability of tossing a 
head on each of three successive tosses is 1/2 X 1/2 X 1/2 
or 1/8. The probability of any other combination of heads and 
tails totals, therefore, 7/8. The eight wavs in wh.Vh 


may land on three 

successive tosses ai 

H H H 
H H T 

Combination 

H T H 

3H 

T H H 

2H, IT 

T T H 

1H, 2T 

T T T 

3T 

T H T 
H T T 

Total 


Occurrences 

1 

3 

3 

1 

i 


Thus it can be seen that three heads should occur only once 
m eight sets of three tosses, in the long run. 

our Work Sampling example, if the best estimate we have 
available of the proportion of time spent in Writing is 0.328 
or 32.8 per cent, then the probability of observing the same 
person Writing on five successive random observations is 0.328^ 
or 0.328 X 0.328 X 0.328 X 0.328 X 0.328, or 0.003796. 
More properly stated, the probability of such a series of five 
consecutive observations is 0.3796 per cent, in the long run, given 
a large number of such series office consecutive random samples. 

is insistence on “the long run” as the proper basis for the 
consideration of true probabilities is made necessary because 
o random, or chance, influences exerted on any small sample 
Perhaps this is easy to grasp intuitively since on each eight sets 
of three tosses of a coin we would hardly expect to see exactly 
the results shown above each time! However, as the number 
o samples of three tosses increased to 80, or 800, or 8,000, we 
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would expect to see a closer adherence to the ratio of 1:3: 3. . 
For a relatively small number of samples, we could have 

considerable deviation from this. 

To illustrate further this same idea, if we tossed the same 
unbiased coin twice, we would not be surprised if we got two 
heads or two tails, even though we know that the com should 
land with a head or a tail up with equal frequency m the 

long run. 

The Binomial Theorem 

Mathematicians have supplied us with a very simple way 
to express these long-run probabilities where an event may 
happen in one of two ways. In order to explore the binomial 
theorem we must adopt some shorthand notations first: 

Lgt p = the probability of result A 
Let q = the probability of result B 
Let n = the number of sample items drawn 
Assume: A and B are the only ways in which the event can 
occur, and are mutually exclusive; i.e., if A happens, B cannot, 
and vice versa. 

Assume: Random sampling conditions prevail, with no 
change in p and q throughout the sampling process. 

Therefore 

9 = 1.000 and (p + qY = i- 000 

The binomial theorem is 

(p + ?)* = 1-000 

This equation can be expanded by the use of simple algebra. 
If n = 2, then 

(p + qY = P 2 + 2 pq + q i = 1-000 

If n = 3, then 

(p + qY = p‘ + 3p*q + 'ipq' 1 + ? 3 = l- 000 


( 2 ) 
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If« = 4, then 

iP + ?) 4 = P' 1 + 4p*q + 6py + 4pq s + q* = 1.000 (3) 

Now let us assume this is the coin-tossing experiment devel¬ 
oped previously in this chapter. Now p = 0.50 and q = 0.50, 
being the respective probabilities of heads and tails. “Plug¬ 
ging in” these values of p and q in formulas (1) to (3), above, 
yields 

0.52 -f- 2(0.5)(0.5) 4 0.5 2 = 1.000 
0.25 4 0.50 + 0.25 = 1.000 ^ 

0*5 3 4 3(0.5) 2 (0.5) 4 3(0.5) (0.5) 2 4 0.5 3 - 1.000 
0.125-f 0.375 4 0.375 4 0.125 = 1.000 ® 

0.5 4 4 4(0.5) 3 (0.5) 4 6(0.5) 2 (0.5) 2 4 4(0.5)(0.5) 3 4 0.5 4 

« 1.000 

0.0625 4 0.2500 4 0.3750 4 0.2500 4 0.0625 ^ 

« 1.000 

In formula (1), the probability of two consecutive heads, or 
two consecutive tails, is 0.25, or one in four, and of one head 
and one tail is 0.50, or one in two. By the same interpretation 
in formula (2), the probability of three consecutive heads, or 
tails, is 0.125, or one in eight, of two heads and one tail is three 
in eight, etc. In formula (3), the probability of four consecu¬ 
tive heads is 0.0625, or one in sixteen, etc. 

The examples above show the perfect symmetry which 
exists in the binomial formula expansion when p = q = 0.50. 
In fact, the binomial expansion in the case where /j = ^ = 0.50, 
and n becomes extremely large, is virtually identical to the normal 
curve, except that it has finite limits, rather than infinite ones 
as in the normal curve. This property of the binomial makes 
the normal curve an excellent approximation of it, and an 
extremely useful Control Chart aid, when only two proba¬ 
bilities are involved, and p and q both lie close to 0.50. 

However, the binomial expansion is most useful as a prob¬ 
ability expression in its own right, for seldom does the equiva- 
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lent condition of p and q prevail! Normally, we must be pre¬ 
pared in Work Sampling for any probability from 0.001 to 
0.999, and we shall usually have many more than two cate¬ 
gories! The binomial expansion enables us to handle both 
conditions. 

To take care of the limitation to two categories, A and B, 
having probabilities of p and q, respectively, we need only take 
any one category as A, and consider the summation of all other 
categories as B, and we can fit our problem to the binomial 
under this method, 

q-\-p 

and we can consider the binomial expression as 
[p+ (1 -p)) n = 1.000 

To take care of the full range of values which p may have, we 
can simply use any value of p in our expression, above. 

In a Work Sampling example, suppose Writing has been 
found to be 20 per cent of total observations, over past studies. 
What is the distribution of Writing versus Other categories 
which we should expect in a large number of samples of five 
observations? 

To solve this, 

[p + (1 - p)] n - 1*000 

becomes 

[ 0.2 -f ( 1.0 - 0 . 2)] 6 - 1.000 

0 2 * + 5 ( 0 . 2 ) 4 ( 0 . 8 ) + 10 ( 0 . 2 ) 3 ( 0 . 8) 2 + 10 ( 0 . 2 ) 2 ( 0 . 8) 3 

+ 5(0.2)(0.8) 4 + 0.8 5 - 1.00000 (4) 

0 00032 T 0.00640 + 0.05120 + 0.20480 + 0.40960 + 0.32768 

= 1.00000 

Thus the distribution (long run) which we should expect m 
samples of five random observations of such a work situation 
as this, where the true proportion of time spent in Writing is 
20 per cent, would be: 
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5 Writing, all Others none ~ 00.032% 

4 Writing, all Others 1 » 00.640% 

3 Writing, all Others 2 « 05.120% 

2 Writing, all Others 3 = 20.480% 

1 Writing, all Others 4 ** 40.960% 

None Writing, all Others 5 « 32.768% 

Total = 10oT000% 

Similarly, the same type of expansion could be made for any 
combination of/>, q, and n. However, as p and q become more 
precise, and as n increases, this calculation becomes fiendishly 
laborious. Fortunately, short-cut aids are readily available 
to assist us in working these out, provided n does not 
exceed lOO.f 

Before going on to the further use of these concepts, it is well 
to note that such questions as the following can now be 
answered for the above distribution: 

1. What is the probability of drawing, in a sample of 5, 3 or 
more observations in the Writing category? This can befound 
by adding the probabilities of obtaining 3, 4, and 5 in a sample 
of 5, or 5.792 per cent. 

2. What is the probability of obtaining not more than 2 
observations nor less than 1 observation in the sample of 5, 
in the Writing category? This is found by adding the prob^ 
abilities of finding exactly 2 and exactly 1, or 61.440 per cent 

Incidentally, the reader may be acquainted with the 
so-called “Poisson distribution,” described and referred to in 
books on quality control and acceptance sampling. Very 
simply stated, the Poisson distribution is an approximation of 
the binomial when p (or q) becomes very small (he., in the 
neighborhood of 5 per cent or less) and n becomes large (i.e., 
100 or more). The user of Work Sampling will have little 
if any need of the Poisson distribution, since the binomial dis- 

f National Bureau of Standards, U.S. Department of Commerce, “Tables of 
Distribution >” AMSG, Government Printing Office, 
1952; H. G. Romig, “50-100 Binomial Tables,” John Wiley & Sons, Inc., New 

Vrirk 1 0^7 * 7 
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tribution covers adequately the full range of values of p and q, 
and offers easy, accessible computation short cuts. 

The Use of Confidence Limits 

In our daily practice of sampling, we frequently find need 
to set up some limits within which we expect results to fall. 
To take an example, if you and a friend are betting on the flip 
of a coin, and he wins the first toss by betting on a head, you 
might reason that since the coin has no “memory,” the prob¬ 
ability of a tail on the second toss is still one-half, only to see 
the coin fall heads up again. And so the same logic might 
lead to a third loss, and a fourth, through successive heads. 
But would you permit the fifth, sixth, etc., toss to continue to 
fall heads? How about the tenth? Suppose it went 15 times, 
each time a head? Would you still bet 50-50, on the premise 

that the coin “has no memory”? 

That there is a very common fallacy in the thinking of many 
people in this matter can be verified by anybody who has 
attempted to teach statistics. Sooner or later in such a situa¬ 
tion, each person reaches his own “limit of credibility or 
“limit of confidence” in the lack of “memory” he assumed 
was present in the coin! For some, three or four straight 
heads (or tails) are enough to cause them to call a halt to the 
proceedings in order to examine the coin. For others, as 
many as seven or eight will suffice, and a stubborn few, locked 
in the vise of a mental assumption they do not realize they 
possess, will go on betting 50-50. (These last are “suckers, 

and good prey for “con” men!) 

What is the paradox here? The answer is amazingly 
simple. To tosses of a coin, most people bring the assumption 
that the coin is unbiased, that is, has an equal probability of 
falling on one side or the other, and hence consider “even 
money” a fair statement of the odds. Therefore, they assume, 
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from a n intuitive basis> that the number Qf headg and Qf ta . ig 

whel COmC K Ut T n ° VCr an CXtended SeriCS ° f tosses = 30 

im r ° ne T betS headS ° r tails ° n any given sin S Ie toss is not 

TernTTh' " ° th T ^ thC ,aW ° f aVCrageS Wil1 P-tect 
• is law of averages protection rests on the two 

both of fh , f he CaSe sometlmes show that one or 
ble lc t tn ? yP eS&S ^ bC inC ° rreCt Jt is a demonstra- 

of I 6 C ° m IS balanCCd - * Furthcrmore > many series 

of tosses are performed under.distinctly nonrandom conditions, 

he logical impasse faced by the bettor when five or six 

Imine L ^ ““ ^ reS ° 1Ved ^ if he wil1 b * reex¬ 
amine his assumptions! While in the case of coin tossing, the 

approach to balance is very close, and nearly random condi¬ 
tions may usually apply, this is seldom true when sampling 
where no convenient p ov q\% available. P g 

In most industrial or business sampling situations, assump- 
ons similar to these, taken at the outset, may lead to devas¬ 
tating results. The user of Work Sampling will do well to 
avoid making assumptions concerning bias or randomness 

of co t C ° ln ; tOSSing ^ Ae feCt that thcre is a Phonal limit 
confidence for each of us, in the number of consecutive tosses 

reatnirh ^ ^ Ieads us -amine the 

reason why various limits are chosen by various people placed 
m the same situation. 

The true probabilities of 1, 2, 3 4 etc tnii, 

ZTZn CC 7T: f the Same faCe 0f a ^ unbiased 

are given in Table 7-1. What motivation induces one person 
to stop and question his assumptions when the odds for the 

even hap pemng , in 16> while another may have his limit 

H ° r 1 ln 256? The answer to this question is prob- 

Perfect” balance is logically impossible! 
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Table 7-1 


No. of Successive 
Occurrences 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 


Expression 


0.50 

0.5 2 

0.5 3 

0.5 4 

0.5 5 

0.5 6 

0.5 7 

0.5 8 

0.5 9 

0.5 10 

0.5 11 

0.5 12 


Probability 


Value 

0.50 

0.2500 

0.125 

0.0625 

0.03125 

0.015625 

0.0078125 

0.00390625 

0.001953125 

0.0009765625 

0.00048828125 

0.000244140625 


Odds 


1/2 

1/4 

1/8 

1/16 

1/32 

1/64 

1/128 

1/256 

1/512 

1/1,024 

1/2,048 

1/4,096 


ably a composite of the many philosophical factors which 
account for the “long-shot player,” the “speculator, or 

. .. tit 


The Standardization of Confidence Limits 

The use of a confidence limit in the foregoing examples is an 
effort to answer this basic question: If the true probability of 
an event occurring is p\ how far from /, in either direction 
may a sample proportion, say, p, depart before it mus ea 
the conclusion that either one or a combination of the folio - 

ing is true? 

1. p' is not the true probability. 

2 The sample is not randomly drawn. 

3 '. The sample was not drawn from the same distribution 

which has been measured or described by/. 

If we place any limit whatever on the extent of the departure 
of* f r0 m p’ and if we then draw a sample yielding a proportion 
beyond the limit, we may expose ourselves to two types o 
errors in logic: 
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1. We may conclude that// is false, when it is really true 

2. We may conclude that/?' is true when it is not. 

Usually when we sample, we are attempting to measure 

something, and measure it to a certain standard of reliability. 
Suppose, after making 1,000 observations in our Work Sam¬ 
pling study, we have found that the occurrences of the'Writing 
category are 200. Therefore, our best estimate of p r is 20.0 per 
cent. Now let us suppose that a subsequent round of 5 obser¬ 
vations shows Writing occurring in all 5 cases. The proba¬ 
bility of this happening has been shown to be 0.032 per cent, 
or about 3 in 10,000. If this probability is beyond our per¬ 
sonal confidence limit, we may conclude that: 

1. The/?' we used does not represent the true proportion of 
Writing present. 

2. The sample proportion p is not a value in which we ca$ 
have confidence, and that, therefore, p' is still true. 

Now observe that, if we adopt the first conclusion (that is, that 
P' * s not true), we cannot be certain this is the correct conclusion! 
Neither can we be certain that the second conclusion is sure! 
This problem in uncertainty can be summarized as follows: 

Conclusions Possible 

Truth Correct Error 

1. Change in p' Change in p ' No change in p' 

2. No change in p' No change in p' Change in p f 

Thus there are two types of errors possible: 

1. We may conclude there fr change, when there really is not. 

2. We may conclude that there is not change, when there is 
really change. 

Our objective in the use of confidence limits is to minimize 
both types of errors. While these may appear to be incom¬ 
patible, experience has shown that a compromise must and 
can be struck between these errors to minimize cost. 

To illustrate our problem, let us return once more to the 
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coin-tossing case, where different risks of error of both kinds 
can be illustrated vividly. The person who permits only two 
successive heads to appear before concluding that the coin is 
biased is choosing a probability of 0.5 2 , or 0.25 as a limit, at 
which he concludes that p' is not 0.50, but something else. 
Referring to our diagram above, he is incurring the following 
risks: 

1. If the coin really is biased in favor of heads, i.e., the true 
probability is not 0.50, he will be correct to stop the tossing 
after two successive heads three times in four. Stated another 
way, the odds are three to one that the coin is biased, and one 
to three that it is not biased. 

2. If the coin is really not biased in favor of heads, i.e., the 
true probability is 0.50, he will be correct to stop the tossing 
after two successive heads one time in four, and will be in error 
three times in four. 

In this case, if the bet is a substantial one, it will be better to 
err in the direction of safety, or the first type of error, to pre¬ 
clude being “taken 55 at an early stage. On the other hand 
the consequences of concluding that the coin is biased when 
it is really not biased may be disastrous! 

In order to be more certain that the coin is really biased, 
and therefore reduce the chance of reaching the incorrect con¬ 
clusion when the coin really is biased, we need only accept a 
smaller limit, say 10 per cent. We pass this point when four 
successive heads are thrown. At this point, we shall be cor¬ 
rect in our conclusion of bias fifteen times in sixteen, and 
incorrect only one time in sixteen. 

If we choose 1 per cent as the long run limit of the proba¬ 
bility of being in error, we would allow six consecutive heads 
to be tossed, but after the seventh head we would call a halt, 
at this point the probability that p f is really 0.50 is only 
0.78125 per cent. 
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Note that this rationale is based upon the assumption that the prob¬ 
abilities of heads and tails are each 0.50. If we were to begin with 
the assumption that there is bias, we would then expect to see 
a “run” on heads, and would therefore set our limits according 
to the values chosen for p' and q\ 

In the use of the confidence limits, we are much assisted by 
adopting the viewpoint that we are really testing whether 
change has taken place, and set our confidence limits to mini¬ 
mize the error of failing to conclude that change has taken 
place, when it really has. 

For these reasons, most statistical confidence limits are 
designed to test the hypothesis that change has not taken place. * In 
this way the risk of failing to identify change is low, and the 
risk of concluding that change has taken place when it really 
has not is also low. 

Let us examine this logic. In most sampling efforts extend¬ 
ing over a number of samples, and usually an extensive period 
of time, we are attempting to do one of the following: 

1. Estimate precisely a constant value 

2. Identify change as it occurs in a variable value 
Whether we are using sampling for one or the other, the con¬ 
venience of working from the hypothesis of “no change” or 

stability, 5 and using confidence limits that minimize the risk 
of failing to identify change, we “catch” deviations more often 
than we miss them; also, by tending to err in the direction of 
concluding there is change when there is not, we shall only 
infrequently find ourselves looking for causes of change when 
none is present. 

Any pragmatist in business will verify the experience that 
“nothing is permanent but change.” Change is indeed a 
constant state of affairs, and the Work Sampler, like the indus¬ 
trial engineer, would rather “cry wolf” occasionally, when no 
* This is called by statisticians the “null hypothesis. 5 ’ 
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wolf is there, than fail to be aware of change when it does 
happen. 

With this logic in mind, users of statistical tools in various 
fields have devolved “risk levels” which have become fairly 
standard. For example, medical analysts seldom draw a con¬ 
clusion concerning possible danger or death to the user of a 
new drug until a very tight confidence limit has been adopted 
and proved. Sometimes a probability of being wrong may be 
almost microscopic, in the neighborhood of 1 in 100,000. In 
agricultural and biological experimentation, and in most 
industrial quality control, a confidence limit of about 1 
chance of error in 350 is used. In other applications, an 
error of 1 per cent or 5 per cent, i.e., a probability of error in 
failing to identify change, is used. 

How to Derive Confidence Limits 

In order to establish these limits for the particular sampling 
problem at hand, some idea of the behavior of “stability” 
under random sampling conditions is necessary. 

Given any true proportion p', we have seen that a sample 
proportion p — p f would not always occur, that is, p (for the 
sample size n) would not always be exactly p . Our problem 
in establishing confidence limits is simply the question: “How 
far from p' may a sample p, found in a sample of n, depart 
from p f before we should conclude that change has taken 
place?” 

The influence of random sampling conditions on p, a sample 
proportion, is described by the normal curve of error, dis¬ 
cussed in the previous chapter. That this is the case can be 
proved mathematically, or derived experimentally. Without 
attempting to prove or derive it here, it can be seen that if we 
can derive and use some standard deviation measure for a dis¬ 
tribution of sample p values, in respect to a //, we can use the 
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table of areas under the normal curve directly, to derive prob¬ 
abilities of obtaining any sample p proportion. 

The formula for the standard deviation of p for any given 
sample size n is 


S.D. =S~„, 


4 


P'{ 1 - p'j t 
n 


(5) 


if/-' is known. This formula is essentially the same for the 
condition where p' is not known. This, of course, is the usual 
situation of the Work Sampler. In this case, an average value 
oip, computed from previous samples, can be used. 

hetp (read “/> bar”) represent the historic average value of 
sample p values, 


JlSLiD = V/(i - p) 


( 6 ) 


If no historic average/! is available, as would be the case if no 
previous samples were available, a standard deviation of a 
single/- value can be obtained by 



The standard deviations derived from formulas (5) to (7) 
have the same significance as the <r value, found in the previous 
chapter, for the normal curve, and the same use can be made 
of it to quickly locate values of p which can be considered as 
beyond any desired confidence limit. 


t Actually, this and succeeding formulas of similar type should 


oy 


Jp'Q ~fi' ) 

V n - 1 


However, since the difference between » - i u 

Win" d" ' * ^ ^ Wh “ * “ ab ° Ut 30 the Work 

to yZ Cai? 1 Safdy by ming » directl y* When attempting 

;hl t j Smgle Sma sara P le > however, there is very little precision 
poss^anyhovv, and use of „ - 1 will increase „ making the estTmate even“ 
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Let us take an example now from Work Sampling. After 
one round of observations of 30 punch-press operators, 6 are 
found to be engaged in “loading and unloading coil stock.” 
After this one sample, we can estimate / for this categoryno 
more precisely than as the ratio of 6 to 30 or 20 per cent. e 
vagaries of sampling will lead us to suspect that successive 
values of p may not be exactly 20 per cent. But how far from 
20 per cent could they be expected to go? If we accept the 
+ 2o- limit, or a probability of being correct approximately 
95 per cent of the time, we could now compute <r p : 

lp( 1 -P) _ 1 0.20(0.80) _ 0 073 (7) 

= \- n \ 30 

Laying off ±2<r„ around 20 per cent shows that our true / 
lies between 5.4 per cent and 34.6 per cent. If we set up 
tighter requirements in so far as error is concerned, say at ± 3a p 
(i.e., demanding accuracy to a probability of about 99 per 
cent), we can safely say that the true / lies between 0.0 per 
cent and 41.9 per cent. These wide limits seem to offer very 
small reliability to our estimate of/. This follows naturally, 
since we have only one sample at hand, and we should not 
expect great precision. 

But now let us take nine more rounds of observations, with 
the results shown in Table 7-2. Now f = e Hoo = 0.213, 
and our ability to lend reliability to it is much greater. Our 
best single estimate of / is now 21.3 per cent, and we now can 
say that / has a probability of 95 per cent of lying between 

f±2 . i -».2 1 3±2^EI|1.0. M ±2 A p|^ 0» 

where N is used to denote m + n 2 + • • • + «io- The con¬ 
fidence limits so set are now 0.213 ± 2(0.024), or from 16.5 per 
cent to 26.1 per cent. If we adopted the requirement that 
our estimate of / must be correct with a confidence limit of 
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Table 7-2 


Sample 

No. 

Sample 

Size 

No. Observed 
Loading and 
Unloading Coil Stock 

P 

1 

30 

6 

0.200 

2 

30 

7 

0.233 

3 

30 

7 

0.233 

4 

30 

8 

0.267 

5 

30 

6 

0.200 

6 

30 

4 

0.133 

7 

30 

9 

0.300 

8 

30 

6 

0.200 

9 

30 

4 

0.133 

10 

30 

7 

0.233 

Total. 

300 

64 

0.213 


99 per cent, approximately, the limits would be 0.213 ± 
3(0.024), or from 14.1 to 28.5 per cent. We can now make 
one additional use of the formula 

Substituting 0.213, or p in the formula, for p, we have 

IF- 0.075 p) 

Now the limits within which sample p values should lie, where 
n “ 30, can be set at ± 2cr p or p ± 3<r p , and we can examine 
our 10 samples to see if stability was present during the 10 
rounds of observations. Suppose we adopt the 95 per cent 
confidence limit here. 

P i 2(Tp = 0.213 + 2(0.075) — 6.3 to 36.3 per cent (10) 

Examination of our 10 samples reveals that any of these values 
could occur by chance alone from a true p f of 21.3 per cent, 
and we can therefore conclude that the conditions of work 
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during sampling were consistent (more properly, that they did 
not differ “significantly 55 ) and that the conditions of random¬ 
ness in the sampling were satisfactory. 

Suppose that at this point management takes some action 
to reduce this category. The objective of Work Sampling is 
not only measurement but also provision for improvement. 
After the improvement is installed, we would expect sample p 
values for the category Loading and Unloading Coil Stock to 
be less. Suppose that samples after the improvement are as 
shown in Table 7-3. Since a sample proportion of 0 per cent, 


Table 7-3 


Sample 

No. 

Sample 

Size 

No. Observed 
Loading and 
Unloading Coil Stock 

V 

11 

30 

3 

0.100 

12 

30 

2 

0.067 

13 

30 

2 

0.067 

14 

30 

0 

0.000 

15 

30 

4 

0.133 


150 

11 

0.073 


as in sample 14, and of two other samples as near our limit 
as samples 12 and 13, would not occur by chance, we can safely 
say that there has been change. This can be further proved 
by assuming the true average to be the previous^, or 21.3 per 
cent, substituting 150 as N rather than 300, in Eq. (8) above, 
which then becomes 

P±2 a t = 0.213 ± 2 = 0.213 ± 2(0.033) 

The lower limit for p from the 150 observations made after the 
improvement is therefore 0.213 — 2(0.033) = 0.147, or 14.7 
per cent. Since our actual p after improvement is 7.3 per 
cent, we are safe in concluding that the change has reduced 
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the incidence of this category, that is, its proportionate time, 
to about one-third of its former amount. 

Incidentally, a change such as this should be reflected in at 
least one other category, and perhaps in many other ones, since 
the reduction of time spent in the category Loading and 



Unloading Coil Stock should make more time available for 
other activities. 

The preceding example can be visualized much more 
readily if we chart the data on a Control Chart for category 
proportions, using the method followed in statistical quality 
control for attributes data. Figure 7-1 illustrates this type of 
graphic device. 

There is great value in charting such data, if for no other 
reason than that it makes comprehension easier. The value 
of the Control Chart is enhanced, however, by its soundness 
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as a mathematical proof of reliability, or stability. While it 
may be “obvious” that in Fig. 7-1 a change in f has taken 
place, it is nonetheless true that “obviousness” is not a uni¬ 
formly defined subjective condition. Statistical control, how¬ 
ever, has precise and objectively correct interpretive condi¬ 
tions associated with it. We shall now turn our attention to 
the meaning of the Control Chart. 
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Use of the Control Chart in 
Work Sampling 


Introduction 

The development and use of the Control Chart method has 
been largely in the field of statistical quality control. Its capa¬ 
bilities as an analytical tool are worthy of its use in many 
other areas of industrial investigation. In fact, generally 
speaking, whenever a quantitative measurement of a variable 
can be made, and it is desirable to test this value as it behaves 
across time, by drawing samples at regular or irregular inter¬ 
vals, seeking to see either stability or change , the Control Chart 
method can be used to advantage. 

While the user of Work Sampling is urged to acquaint him¬ 
self with a fuller discussion of the Control Chart method * 

some working rules for its construction, interpretation, and use 
will be given here. 


Types of Control Charts 


In Work Sampling, there are two principal types of Control 
Charts, which we shall call the p chart and the r chart, 
a though the connotations of p and c are slightly different than 
m the conventional quality control meaning. 


* See E. L. Grant, “Statistical Quality Control ” 
Company, Inc., New York, 1952. 


2d ed., McGraw-Hill Book 
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The p chart may be called the “chart for category propor¬ 
tions,” and is used to plot percentages found in a single cate¬ 
gory, or group of categories, in successive samples. This is 
the basic type of chart for analysis of results. 

The c chart may be called the “chart for observations (or 
rounds of observations) per selected time interval.” This 
chart is used after a study is well under way, in order to ensure 
randomness in the observation times. 

Constructing the Chart 

Center Lines 

1. p chart. In the course of the first few rounds of obser¬ 
vations, a number of p values for a given category, say pu pi, 
p„ p t , etc., are obtained. These values are averaged, and 
called p, which becomes the value of the center line on the 
chart. 

2. c chart. The center line of the c chart is the average c 
value from the study. 

Plotting Points. After at least 10 rounds of observations, 
or at least 300 individual observations (based on 10 categories), 
have been made, the individual p (or c) values are plotted on 
the chart as shown in Fig. 8-1. Since p (or t) represents the 
center line, these individual/- (or c) values will occur on both 
sides of the center line. 

Selecting the Scale. The scale (vertical) for the chart 
should be designed in order to satisfy three conditions: 

1. It should be easy to read. 

2. It should permit plotting of the largest expected value. 

3. It should always originate at the value 0, or zero, in order 
to preserve the relative amount of deviation from point to point. 

Establishing Limit Lines. The setting of limits within 
which points should lie can be done in two ways: 
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1- By using sample p values from the study itself 

• By deciding in advance what proportionate departure 
rom the center-line value will be permitted 


_UCL* 33.8 



L.CL-10.2" 


Sample number 
Fig. 8-1 

The second method is appealing, perhaps, 

Zton " n ”' h ° d Wi “ U ”«™ d f « » '»"» 

f Z 10 “7 >,es r avai ' able> “ ■ ,, “ d * b °™. “<■ 

.o obZ. ' , r formu,a (s) - W M. «. be 
h.ZlZZ, y '°®. * " ±3 "' “>“” d f cstabliehes 

” a Pproximately He 95 per rent and 99 per cent 

confidence limits, respectively. 

When using the c chart, 


t For derivation, see Grant, op. 


= Vet 



Work Sampling 

104 

Again, laying off ±>.00 ± i* « P* cen.or » 

cent confidence limits, respectively. 

Choos»o B«Tw«n 2a ano Ln™. Smc„n«n.tet,non 

of the limits would be as follows: 

Tin the long run, iff (* *) « ^ ** average, then only onepor, 

ft. 20, M the average, should lie beyond any 2* ftm* .oronl *«- 
in 100 points should lie beyond any 3«r limt, ./ statist^ stahhty 

PT \ if a point or points occur beyond the limit lmes ’ ^ 
sh ould conclude that stability is present, 
identify the reason for the change m p (or c). While one ti 
in 20, or one time in 100, we shall be seeking a cause of change 
when none really exists, we shall be correct in seeking such a 
cause on the average, 19 times in 20, or 99 times in 100. 

Whether to select ±2<r limits or ±3<r limits or any other set 
of Lts, is really a problem in balancing rishs. Based upon 
experience in many Work Sampling situations, it is recom 
mended that the following reasoning be used. 

1 Select + 2<r limits when beginning a Work Samp mg s u y. 

2 Use iitr limits .to 

measure the proportions of time now being spent in the 

“tie, chose* the f obtain «>r 

Lily proves to be too high or too low to be considered a tote 
able proponion. This is logical, since 

ultimate objective of any Work Sampling slu cly. ^ risk eg 
m med (a more sensitive indicator of mffabd.ty tf the rt± of 
error is tolerable), we will be able to discern change fast. tte 
ff +V limits are used. Normally, as “ * 

distribution of categmy proportion, me achieved, we- ' 
able to revise our f value, more quickly, and hence mem 
the extent of the improvement. 
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As improvement efforts yield results desired, we should 
expect to see stability in the category proportions at more 
desirable levels. Therefore, we should then attempt to mini¬ 
mize the risk of seeking causes of change when they are really 
not present. This can be done by adoption of +3cr limits 
after the desired distribution of time has been reached. 

One factor in this choice which may affect our selection of 
limits in the above way, however, is our dependence on random 
sampling. Sometimes nonrandom influences are present, par¬ 
ticularly in the early stages of a study, e.g., an observer delib¬ 
erately failing to record a category when it occurs, and record¬ 
ing it as something else; or nonrandom intervals being used 
between observations; or any other biasing influence on results. 
When these types of nonrandom effects are present, or are 
suspected to be present, a ±3cr limit should be used on cate¬ 
gory proportions until these influences are removed. In fact , 
as long as they are present , any limits used , aroundp, have no statistical 
significance. It is vital that the conditions of randomness be 
fulfilled. 

Interpretation of the Control Chart 

The Appearance of Stability. By defining the appear¬ 
ance on a Control Chart of a stable distribution (i.e., devia¬ 
tions in p , or c , values occur only through chance), we can 
derive rules for detecting instability . In general, a control 
chart for a stable distribution of p , or c, values should exhibit 
the following characteristics: 

1. All points should fall within the limit lines. 

2. Points should cluster near the center line. 

3. Points should occasionally dart out near the limit lines. 

The easiest way to visualize this is to think of a chart where 

the points occur without any apparent order, but where, after 
50 or 100 points have been plotted, the chart could be laid on 
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its vertical axis, and the points dislodged and “shaken down 55 
perpendicularly to the axis, when they would create a normal 
curve appearance. Figure 8-2 illustrates this analogy. 

With this established, what then are the appearances of 
instability? For Work Sampling purposes, assuming randomness 
is present, the patterns of instability can be classified into four 
main types: 

1, Mixture 

2, Cyclic effects 

3. Trend effects 

4. Stratification effects 

Mixture . This term is used to indicate a mixture of essen¬ 
tially different distributions of p (or c). Figure 8-3 is an 
example of this. 

When we sample from two or three different distributions 
without knowing it, our p values obtained will depend upon 
the proportion of the sample items drawn from each. This 
is analogous to drawing a sample consisting of both apples 
and peaches, and attempting to average the two, in order to 
draw a conclusion about the apples! 

For the Work Sampler, the appearance of mixture may 
occur for several reasons: 

1. He is averaging p values from more than one type of job, 
or machine operation, or other cause of difference in time dis¬ 
tributions. To correct this cause of mixture, the jobs or com¬ 
ponent groups must be broken out sufficiently finely as to deal 
with only one distribution at a time. 

2. He is sampling from the same distribution, but the dis¬ 
tribution proportion (i.e., the real proportion of time spent in 
the category) is widely fluctuating and seldom stable, usually 
because of differences in method, supervision attention, oper¬ 
ator training, machine efficiency, machine condition, etc. 
Usually these are caused by lack of sufficient and proper man- 
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agement attention. To correct this cause of mixture, some 

effort must be made to standardize the conditions causing its 
appearance. 


Cydic Effects. Frequently the Work Sampler is faced with a 
periodically fluctuating condition, sometimes at regular and 



Fra. 8-3 

predictable intervals, where volume of work load, proportion 
of equipment utilization, or other known factors are the causes. 
In this case, the behavior of p values during the cycle will vary 
directly or inversely in a rhythmic manner. This condition 
is perhaps a type of mixture, but occurs with sufficient fre- 
quency to be identified separately. 
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The pattern of the Control Chart under cyclic conditions of 
work should reflect the extent of the influence of the cycle on 
p value distributions. It is reasonable, therefore, to expect 
the value of p to be high at some times and low at others. In 
fact, p may be changing almost constantly because of these 

cyclic influences. 



When definite and discernible levels of activity are present, 
different levels oip should be determined, and limit lines estab¬ 
lished for each. It is important, however, to note that when 
this condition is present, all categories do not necessarily 
change their p values proportionately! Figure 8-4 is an exam¬ 
ple of a situation where two distinct levels of p are used. 

Trend Effects. As a Work Sampling study proceeds, 
improvements should be made which have the effect on p 
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values desired by management. The direction of the move¬ 
ment desired in^ may be up, as in the case of Fig. 8-5, or down, 
as in the case of a nonproductive, avoidable category. 

A gradual improvement, or trend, may take place which 
takes quite a long while to appear as a point beyond a limit 
line on the Control Chart. There are, however, ways avail¬ 
able to detect these gradual changes before a point actually 
exceeds a limit. In statistical quality control, these methods, 
or tests, are known as “nonparametric” tests for instability.' 

30 r Training begun 




LCL 


ZL 


50 


f° 20 30 40- 

Sample number 

on Ztb EXa rT Ie ° f a m r urable ^ m P rovemen t observations of foremen 

r-Aacirfts? “»■— - * 


In general, they are based on the statistical theory of “runs” 
above and below a center line. In their simplest form, they 
reduce to the following: 

A change in the value of may be considered as having 
taken place under these conditions: 


1. Using +2o- limits 

When two or more consecutive points occur between 
+l<r and +2cr, or between — ler and —2a- 
b. When five or more consecutive points occur on the same 
side of the center line, but within the limit on that side 
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2. Using ±3cr limits 

a. When, in any set of three consecutive points, any two 
lie between +2 a and +3<r, or -2<r and -3<r, the third 
occurring anywhere else, between the limits 

b. When, in any set of five consecutive points, any four 
' lie between + \<r and +3<r, or between -l<r and -3<r, 

the fifth occurring anywhere else, between the limits 

c. Whenever eight or more consecutive points lie on the 
same side of the center line, but within the limit, none 
exceeding the limit line 

d. When, in a set of eleven consecutive points, any ten 
are on the same side of the center line but within the 
limit, the eleventh being on the other side, but within 
the limit on that side 

e. When, in a set of fourteen consecutive points, any 
twelve are on the same side of the center line but 
within the limit, the remaining two being on the other 
side, but within the limit on that side 

Having rules such as these* available enables the Work 
Sampler to detect trend effects more easily and quickly. 

Stratification Effects. The word “stratification” implies 
strata, or layers, being present. This is its literal meaning here, 
as can be illustrated by its appearance on a Control Chart, 
Fig. 8-6. One of the requirements of a stable pattern was the 
occasional darting of points out near the limit lines. When 
points tend to cluster at about the same value on the chart, 
we can usually conclude that some systematic error is present 

in sampling. 

For example, in a maintenance study, involving a number 
of rapidly reassigned mechanics, the foreman, who was the 
observer, was found to be stratifying the results of his study 

♦For a derivation of these nonparametric tests see Grant, op. at., pp. 

217-218. 
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by observing the same pair of men mueh more frequently than 
others and some other men hardly at all. For this reason, 
e values of^ tended to appear too stable. Investigation in 
is case soon revealed the cause, and the observer corrected 
this systematic bias. Note here that the cause was not a non- 
random influence in so far as observation time was concerned 
but a nonrandom influence in respect to the probability of 
observing any one person! X 



20 

Sample number 

Observer tended to record certain nerson ^ tabhshed from previous studies. 
Periods, 

Correction of stratification can be made only by locating 

and removing the cause of it ti,„ X X at ng 

_ , , 8 Use ot lt The nonparametric tests are 

powerful weapons in this problem of detection of stratification. 

How to Achieve Randomness 

Random Observation Times. A number of ways are 
available for assigning observation times so that the interval 

me7oH n f f° nS " rand ° mly diStHbuted ’ but ** easiest 
ethod for people to understand and use involves a table of 

Numb“s ’ SUCh " APPCndiX Rand °“ Sam P^g 

Randomness may be desired within any given period of 
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time, depending on the use of the study, the period during 
which observations are to be made, and the extent o wr 
week or within-hour volume fluctuations. If an observe 
expected to make a round of observations on the average once 
an hour, randomness within each hour is probably the basts 
which will be sought. If, say, five rounds per day_ w^b 
made, randomness across each 8-hour day will be easy to fulfill, 
while if the study is to be a long one (say, 3 months), random¬ 
ness within each 40-hour week can be obtained. 

A table of random numbers is derived by a method almos 
exactly^equi valent to pu,,in S .0 chip, numbered 0 to 9 ,»<o 
a hat stirring them up thoroughly, drawing one by chance, 
recording its number, replacing it; stirring, drawing, recor - 
Z replying, etc, many time. The statistical theory perU- 
nent to this may be found in most textbooks on quality cont . 

The result is a simple listing of numbers, not arranged i 
any ordered way, and which can be read horizontal y, fro 
left or right, vertically from top or bottom, diagonally, or 
any other ^ay, since each number occurs on the page in a 
random way. Thus we can select one, two, three, or any 
consecutive number of digits which we may want, as they 
appear To illustrate the use of a table of random numbers, 
let us take two examples: (1) Observer to take eight rounds 
of observations per eight-hour shift. (2) Observer to make 
five rounds of observations per eight-hour shift. 

1 Using a table of random numbers, the observer records 

ealh suceLve twodisi, number from 00 » 50 - he = 
to them, beginning, for example, in the upper left-hand corner. 
The first number is 07, which becomes 8:07 a^m. ; the nexus 25, 
which becomes 9:25 a.m., etc. Thus for a 2-week study, the 

schedule in Table 8-1 would appear. 

If half-hourly intervals are desired, record successive two- 

digit numbers from 00 to 29. 
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Table 8-1 




A, 







Bay 





p. 


No. 

8:XX 

9:XX 

10:XX 

11:XX 

1:XX 

2:XX 

3:XX 

4:XX 


XX “ 

XX = 

XX - 

XX = 

XX - 

XX = 

XX = 

XX - 

1 

07 

25 

44 

08 

38 

01 

04 

13 

2 

52 

22 

30 

39 

44 

13 

50 

57 

3 

39 

54 

37 

58 

41 

11 

08 

12 

4 

12 

31 

00 

17 

25 

06 

00 

45 

5 

06 

47 

[ 09 

53 

42 

51 

42 

21 

6 

03 

20 

05 

35 

30 

' 06 

12 

09 

7 

55 

09 

36 

54 

52 

28 

24 

30 

8 

09 

56 

31 

50 

08 

37 

42 

43 

9 

10 

58 

33 

24 

20 

41 

51 

29 

04 

21 

27 

42 

12 

04 

31 

29 

20 


2. Since a day of 8 working hours contains 480 minutes, 
numbers from 000 to 479 can be selected, and considered in 
groups of five. These five are then arranged and added to the 
starting time. As an example, see Table 8-2. 

In the case where a prescribed or contractual “rest period” 




Table 8-2 


Random Numbers 

Array 

Time 

1 

2 

3 

4 

5 

078 

254 

472 

083 

010 

010 

078 

083 

254 

472 

8:10 a.m. 
9:18 a.m. 
9:23 a.m. 
1:14 p.m. 
4:52 p.m. 

1 

2 

3 

4 

5 

413 

222 

303 

441 

350 

222 

303 

350 

413 

441 

11:42 a.m. 
2:03 p.m. 
2:50 p.m. 
3:53 p.m. 
4:21 p.m. 

1 

2 

3 

4 

5 

395 

478 

378 

411 

108 

108 

378 

395 

411 

478 

9:48 a.m. 
3:18 p.m. 
3:35 p.m. 
3:51 p.m. 
4:58 p.m. 


etc. 

etc. 

etc. 
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is used, no observations should be scheduled during the exact 
nominal interval itself, in order to prevent occurrence of 
opportunity to misinterpret results of the study. After all, 
the round of observations made during such an interval will 
certainly not yield a contribution to our knowledge of the 
working time distribution! 

If the random numbers happen to occur in such a manner 
that a subsequent round is to be begun before a previous round 
is completed, another time should be substituted for the second 
round, by simply using the next random number as it appears 
in the table. For example, in (1), above, on the seventh day, 
rounds of observations are scheduled for 8:55 and 9:09 a.m. 
If at least 15 minutes are required to complete the round, the 
9:09 should be replaced with 9:41, since 41 is the next two- 
digit number less than 60 appearing in the table. 

Sometimes, the assignment of observation times is inexpe¬ 
dient, especially when dealing with operations such as widely 
scattered maintenance or construction work, when the foreman 
is the observer. In these cases, a method should be provided 
for the observer to record the times when observations were 
made, by intervals used as the periods within which random¬ 
ness is desired. Figure 8-7 is an example of such a method. 

The form shown as Fig. 8-7 was given to the foreman 
each month. As he made successive rounds of observations, 
he put an X in the next open block corresponding to that time, 
working from the left. He was expected to make about 90 
rounds of observations per month, and this is indicated by the 
center double vertical line. The heavy vertical lines bracket¬ 
ing the double heavy line were established as the least and most 
rounds per interval by the Work Sampling supervisor. As the 
foreman proceeded during the month, he found it possible to 
“keep score” himself and thus be sure he covered each interval 

adequately. 
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MONTHLY RECORD OF TIME PERIOD USAGE 

Observer Name ____ 

Observer No__________________ 

Month__ 


Time 

Periods 

Number of Observation Trips 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

0730-0745 





— 

— 


0800-0815 


0830-0845 



— 







i0900-0915 

— 






— 

— 


0930-0945 



— 



— 

— 

1000-1015 



1030-1045 

1100-1115 

—_ 


— 



— 

— 

— 




1130-1145 






1200-1215 

— 



— 

- 

— 



—— 




1230-1245 


1300-1315 




1330-1345 






— 



1400-1415 




1430-1445 

— 




ml 


— 



— 


-— 

1500-1515 

1530-1545 

— 










1600-1615 





8 

9 

10 1' 

11 

12 


1 

_____ 

3 

4 

6 7 


Use of Chart 

1. After taking an observation trip, place an X in the time period row 
that corresponds to the time the trip was taken. Begin at the left-hand 
side of the chart. 

2. When a time period already has been used (marked with an X) and 
is to be used again, mark X next to the previous X. Thus the chart is built 
from left to right as the month progresses. 

3. At the end of the month, the last X in each row should lie somewhere 
between the two heavy single lines, or the difference between the greatest 

number of X’s and the least number of X’s in any row should not be more 
than_ 

4. During the latter part of the month, attention should be put on those 
time periods that have the least number of X's. 

Fig. 8-7 
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Use of the c Chart to Test for Randomness 

Sometimes it is impossible for an observer to make a round 
of observations at the scheduled time, in which case the round 
may be missed entirely, or taken as soon thereafter as possible. 
No appreciable effect on the basic randomness of the study will 
necessarily result, since the causes of the missing of observa¬ 
tions may themselves be randomly distributed. It is good 
practice, however, to check periodically on the adherence to 
the basic requirement of randomness. This can be done quite 



Fig. 8-8. Control Chart for observations per 5-minute interval, March 15 to 
May 15, 1954. 

c = mean number of observations (cycles) within the 5-minute period 

UCLs ~ c + ?>y/i * upper control limit 

LCLc - c — 3\/d = lower control limit 

Total observations (cycles) = 354 

Total observations (individuals) = 6,122 

Total people observed = 27 

easily by use of the c chart, the chart for observation rounds 
(or observations) per selected time interval. This chart shows 
whether the working period was covered uniformly, that is, no 
one time was favored or unduly avoided by the observer. 

Such a c chart is shown in Fig. 8-8, where it can be noted 
that an average number of observation rounds per 5-minute 
period was 3.69. Control limit lines (at ±3<r c ) were estab¬ 
lished, the points plotted, and excellent stability is shown. 
The same data, plotted by 10-minute, 15-minute, 30-minute, 
and 60-minute intervals, also exhibited stability. In this 
study, many of the observation rounds were missed, and many 
taken at times other than those assigned in advance. 


Use of the Control Chart in Work Sampling j 17 

The basic c may be defined in two ways: 

1. Observation rounds per time interval 

2. Observations per time interval 

Figure 8-8 is drawn for the first definition of c. When observa¬ 
tions themselves are used as c, then a much narrower dispersion 
can be permitted than is shown in Fig. 8-8. 

For Fig. 8-8, the total number of rounds of observations was 
354. Total man-observations, however, were 6,122, or about 
17 persons per round, on the average. Using 96 intervals of 
5 minutes each, c based on rounds of observations is 3.69, or 
354/96. If man-observations per interval, however, are 
plotted, c is 6,122/96, or 63.77. The limit lines for c = 3.69 
are: 

f ± 3 V? = 3.69 + 3 \/3^69 = 3.69 + 3(1.92) 

Limits are 0.00 and 9.45. The limit lines for i = 63.77 are 
s ± 3 Vi = 63.77 ± 3 y/WbTi = 63.77 ± 3(7.99) 

Limits are 39.80 and 87.74. By inspection of these limits, it 
can be seen that if random times for rounds of observations are 
made, and assuming 17 persons observed per round, from 
17(0.00) to 17(9.45), or 0 to 160, man-observations per interval 
would be allowed, whereas if a random distribution of man- 
observations per 5-minute interval were demanded, from 40 tp 
87 would have to occur! Expressed in a different way, from 
0 to 9 observation rounds per 5-minute interval would suffice 
if randomness for the distribution of rounds of observation is 
desired, whereas from 39.80/17 to 87.74/17, or from 3 to 5, 
rounds would be necessary for randomness of individual man- 
observations. It is apparent, then, that in order to achieve 
randomness of individual observations, a very tightly defined 

number of observations in a specified time interval must be 
used. 

In most Work Sampling practice, the use of randomly dis- 
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tributed times for rounds of observations is all that is required. 
The only case where the randomness of man-observations 
should be attempted is where partial rounds, or highly variable 
sizes of groups observed during different times in the day, are 

present. 

Other Uses of the Control Chart in Work Sampling 

After a considerable number of observations have been 
made, it may be desired to study the differences in time distri¬ 
bution by individual workers, or individual machines, being 
observed. While a Work Sampling study should never be 
used as the basis for punitive action in regard to individual 
employees, it is a valid basis, when sufficient data are available, 
for training effort where improper methods, causing substand¬ 
ard production, are being used. A p chart showing the distri¬ 
butions of observations for several employees or machines can 
be truly revealing as an aid to training and to machine 
replacement decisions. 

Case studies in the latter part of this book show several other 
uses of the Control Chart in Work Sampling studies. 
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Evaluating and Presenting Results of 
Work Sampling 


In evaluating and presenting the results of Work Sampling 

there are four distinct procedures to be considered. These 
are: 

1. Evaluating the validity of data 

2. Evaluating the reliability of data 

3. Presenting and analyzing data 

4. Planning for future studies 


Evaluating the Validity of Data 


n the first procedure, a premium is placed on the alertness 
of the director of the study and on the soundness of the pre¬ 
paratory steps in the study. The dictionary defines “valid” 
as based on evidence that can be supported.” For our pur¬ 
poses this means that the results of the study should be able to 
meet the test of agreement with other reliable measures which 
while they may measure only a part of the information gath¬ 
ered m Work Sampling, should be correlated with the study 
results wherever possible. Evaluation of validity is really an 
evaluation of the entire process of gathering and recording the 


Three things are necessary to evaluate the validity of 
Work Sampling study. These are: 


a 


IT? 
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1. Alertness and objectivity on the part of the director o 
the study. In a word, he must be a “bird dog.” 

2. Familiarity with, and understanding of, the principles 
and techniques of statistics discussed in Chaps. 6 to 8. 

3. A complete record of conditions surrounding the taking 
of observations, including measures of production. 

In Work Sampling, as in other measurement techniques, a 
certain amount of error may be expected. One of the advan¬ 
tages of Work Sampling is that since it has its foundation m 
statistical practice, errors may be identified and classified 
somewhat more easily than if more subjective means are 
involved. But these errors must be recognized as such, they 
must be defined and quantified, and they must be corrected 
Primary responsibility for all of this rests with the director of 

the study. 

What form do such errors take? Most causes of low validity 
are systematic errors which arise as a result of misunderstand¬ 
ing or failure to follow proper technique in gathering data. 

As examples, consider the following: 

1. Failure of the observer properly to identify personnel. 
This resulted in the inference that personnel were not properly 
assigned to jobs. It was detected when the data were sum¬ 
marized and corrected by discussion with observer. 

2. Failure of observer to note “special” conditions. In this 
case hazardous conditions were made the subject of a special 
set of working and safety rules. The observer treated two 
days’ operation under these conditions as if they were normal 
days. The director noted the change in study results an 
corrected the situation. 

3. Failure of foreman to notify observer of process change. 
In this case the changes were not apparent to the observer. 
Previous agreement to notify observer was violated. Again, 
the director “caught” the change and corrected the study. 
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selected, the oblation must have b«n recordedin an incor- 
rect category, and a corresponding error must appear • 

ThL very faci makes it possible to cross-check the proportrons 
of observations in each category as an aid to validation. 

Evaluating the validity of data is an essential step m a good 
Work Sampling study. It enables the 

proper degree of confidence m the result. It may serv^ ^ 

basis for simplification of record keeping. i , 
appears to be an unexplained systematic error, the first step 
ll have been taken in the identification of such error. If a 
shop or office is not operating as management thinks it is, posi- 
te indication of this fact certainly is of value. In any event, 
if the condition that the results are valid has been satis 
presentation of data can go forward. If low validity is prese , 
the causes of this will be of interest to management, Y 

mistakes may be avoided. 

Evoluoting the Reliability of Data 

Chapters 6, 7, and 8 have predated the statistical pro¬ 
cess for the performance of this step. The purpme of h.s 
fccSon is to point ou, that the reliability of Work Sahrphng 

darnTpends primarily upon <he number of observ.tron., ./ 
dn^observations were taken under random 

dons. Aet»ahy,.malmos.eondn»ou.ev.lu.^onofrfmb^ 

should be in progress as the study is made. 

d»“ of relLb-lity hr* been established, the far, should 1* 
evident through test, for this which am outlined m Chaps. 6, 

7 ' deviating the reliability o, result, of Work 

end uses and objectives of dre study must mrve as the « 

criteria The basic question is an economic o . 

^ to - more 

bility if stability is present. But what degre 
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needed?. When do we reach the point of diminishing returns? 
What is the practical level of reliability? The answers to these 
questions are contained in another question: “To what use will 
the study be put?” 

Referring to the uses of Work Sampling in Chap. 4, the 
degree of reliability required in general increases in the order 
of the list. A good way to make an evaluation of this sort is 
to calculate the 95 per cent confidence level, and then decide 
whether in each case the actual figures for these limits will be 
acceptable. No rigid rule can be established. The 95 per 
cent level is suggested because in most cases this represents a 
level that is reasonable and well understood. In other words, 
most managers will accept figures that will be consistent 
nineteen times out of twenty. 

The exception to the general rule occurs when the results 
of Work Sampling are to be used in conjunction with existing 
time standards set by other methods. In this case, the relia¬ 
bility of Work Sampling results should be consistent with the 
known reliability of these other time standards. This is not 
as demanding a condition as it may seem. At the 95 per cent 
confidence level, for example, both stop-watch time study and 
predetermined human work times usually exhibit reliability of 
no better than plus or minus 10 per cent. Lehrer* in time 
study and Lazarus f in predetermined human work times sup¬ 
port this view. A word of caution, however, is in order. 
Individual structures of time standards in particular shops and 
offices may attain greater or less reliability than the figure 
cited as typical. And it is the particular degree of reliability 
which must be used as the basis of comparison. Determine 
the reliability of existing time standards in your own situation, 

Jun*e R i949. Lehrer ’ D ° Ct ° ral DisSertation (-“Published), Purdue University’ 
Time 1 '1952 LaZamS ’ D ° Ct0raI Disscrtati ™ (unpublished), Purdue University, 
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and strive for a degree of reliability in Work Sampling that is 
consistent with it. 

Finally, in determining goals of reliability, the Contro 
Chart approach is invaluable. The Chart for Category Pro- 
portions technique will enable the director of the study to 
obtain a grasp of the behavior of results which should be of 
tremendous assistance in deciding upon levels of reliability to 
be sought. The Chart for Category Proportions, the end use 
of the study, and the judgment of supervision as to what relia¬ 
bility is needed should enable a proper appraisal of reliability 
to be made. 

Presenting and Analyzing Data 

The basic data resulting from a Work Sampling study are a 
series of proportions or percentages of observations which have 
been classified into the various categories. In general, each 
observation includes notation of the following variables: 

\ _ The person or unit of equipment observed 

2. The time of observation 

3. The category into which the observed activity, state, or 
condition is classified 

4. Surrounding conditions (such as type of production, 
unusual shop situation, etc.) 

Any presentation of results must come from analysis of these 
variables, and all tables, charts, and graphic displays have as 
their basis only the Work Sampling observations. Therefore 
the planning stages of a Work Sampling study should be made 
a matter of attention not only by those who will perform the 
sampling, but also by those who will base decisions upon the 

results. 

It is a fundamental of the selection of categories that combi- 
nation of categories is possible, but division is not. Therefore 
the initial degree of fineness of categories will determine the 
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detail in which results may be presented. One of the reasons 
for using punched cards in processing Work Sampling data is 
that it is desirable to examine closely a number of variables, and 
perhaps to present results in a number of different ways 

Under such circumstances, punched cards may be useful and 
economical. 

In presenting the results of a Work Sampling study, the pro¬ 
portions or percentages may be given more meaning by the 
following techniques: 

1. Combining categories into broad classes, such as Useful, 
Service, and Delay activity. 

2. Expressing results directly in terms of dollars spent in 

various categories. This is particularly useful in equipment 
studies. 

3. Charting results on a time axis, to show trends and 
peak-load conditions. 

4. Charting or tabulating Work Sampling results to show 
the relationship of these to measures of output. 

These suggestions by no means begin to exhaust the list of 
methods of presentation of Work Sampling data. Results 
may be organized by shop area, by job classification, by types 
of job worked on, or in many other ways. Categories may 
be grouped to reflect time-study categories, direct versus indi¬ 
rect labor, production delays, or similar measures used by 
supervision. 7 

The most common organization of summary sheets for data 
collection is to tabulate personnel or machines against the 
category of activity observed for each, and to summarize by 
the day or week on separate sheets. When specific questions 
arise, reorganization of data becomes necessary. Also the 
same type of report will not be made for each level of super¬ 
vision. It is up to the director of the study to ascertain man¬ 
agement needs with respect to reporting of Work Sampling 






126 


Work Sampling 


results. Within the limitations of category description, relia¬ 
bility, and validity, he should see to it that these needs are met. 
A Work Sampling study is effective only to the extent that it is 
used The reporting of results, therefore, must be done in such 
a manner that meaningful information of the proper degree of 
detail is put in the hands of management decision makers. 
The criterion should be “What action is initiated as a result of 

this report? 5 ’ 

Some examples of presentation of Work Sampling data are 


as follows: 

Table 9-1 is a table of over-all proportions, by categories 
and by type of equipment, of a study made of tabulating equip¬ 
ment. Personnel were not studied. This table indicated the 

total of activity. It did not indicate work-load fluctuations. 
Table 9-1. Cateo oeies Used in Tabulate Depaetment Study 

| Category 


Total, all machines. 

Key punch (6 machines). 
Tabulators (3 machines). . 
Sorters (3 machines).. 
Multiplier, interpreter, 
verifier, interfiler (1 ea—, 
Bookkeeping machines (3) 


No. 1 

No. 2 

No. 3 

No. 4 

No. 5 

No. 6 

No. 7 

33.5 

14.3 

1.8 

1.5 

45.0 

2.1 

1.8 

47.7 

19.5 

0 

1.5 

25.4 

0.5 

5.4 

23.9 

13.2 

11.0 

4.4 

46.0 

1.5 

0 

, 37.8 

20.8 

0 

1.0 

30.9 

9.5 

0 

i 20.5 

3.9 

0 

0.1 

75.2 

0.3 

0 

24.4 

11.8 

0 

0.9 

62.6 

0.3 

0 


1. Operating and running 

2. Operating—not running 

3. Summarizing 

4. Not running, but set up to run 


5. Available (no job to put on 
machine) 

6. Maintenance (not available) 

7. Trainee 


Figure 9-1 is a chart showing the data from the table 
above, but organized along a time axis to show work-load 
fluctuations and the interrelationships of demand upon the 


different types of equipment. 

Figure 9-2 is a chart showing the dollar distribution of the 
same activity. This is particularly appropriate in equipment 






!9 20 23 24 25 S 27 J * £ f g T W T. p. M T w ") p "»" S - 

M °> 2 3 6 7 8 9 0 ,3 ,4 % J ,9 & J, 


May 

1? n June 

^ig. 9-1. Typical chart of work-load fluctuations. 


In addition to the broad analysis expressed in charts there 
are many eases in which a particular proportion or perc^I 
of interest. For example, consider the following- § 

1- A textile mill wanted to establish how much in labor time 
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study revealed that loom change-over to meet this ae 

1J per cent Pricing and production dcoston, could bemad. 

w»«.»h»» 

was spent in revisions of blueprints. Thts 

necesLy in pton^ the work of d«..g»er. and eheckers. 


| 6,000 


c 4,000 


| 2,000 


Training, setup, 
and summotinq 


Waintendnce 


Fio . department (labOT 

not included). 

3. A group of six engineers working in one office had asked 
that an additional telephone be installed. W °* 
indicated that only 0.6 per cent of the tune were botffiprese^ y 
installed telephones in use simultaneous y. 

‘'^^ItwarfounJffi'fhospital study that student nmseswcre 

(1.3 per cent) proportion of the time. 

desirable amount of time for such instruction. 

^ . . . • ..mi! to be m use 
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by machine operators mainly for offhand and rough grin ding , 
Instruction in tool care was started, and a cheaper machine 
was put into use. 

The great advantage of Work Sampling in cases such as 
those cited above is that the information is gathered almost as 
a by-product of the study. Also, the results are expressed in 
numerical form, with a known reliability. This enables deci¬ 
sions to be made based on fact. Figures of speech such as “a 
lot or “not much” may be useful in general discussion, but 
numerical results are more appropriate to the making of 
economic choice. 

To summarize, the basic data of Work Sampling are 
expressed as proportions of time. The variables present are 
those of personnel or equipment, category of activity, sur¬ 
rounding conditions, and time of observation. It is up to the 
director of the study to combine and arrange these into reports 
and graphic presentations which will enable the recipient of 
each report to take whatever action is appropriate. It is 
expected that a number of different presentations will be made 
from the same basic data. Finally, the director of the study 
should be sure that the reports are what the user needs. 

Planning for Future Studies 

Throughout the text constant reference has been made to 
the Work Sampling study. This is an appropriate term, 
because at some agreed-upon point it usually may be said that 
the initial objectives have been met and that a review of prog¬ 
ress and an evaluation of results are in order. The factors 
affecting the point at which this review is done are the number 
of observations necessary to obtain proper reliability, and the 
monthly, weekly, or other cyclic conditions which it is con¬ 
sidered desirable to encompass in the study. 

Action taken as a result of review and evaluation depends 
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upon the nature of the study and upon the conditions revealed 
by the study. In many cases the first use of Work Sampling 
serves to establish the technique, and it is then adopted in other 
parts of the organization. In such cases, the categories used 
in the first study should be considered carefully as a means of 
setting up comparisons across organizational divisions. Meth¬ 
odology should be kept consistent, but no other special instruc¬ 
tions are necessary for broadening the use of Work Sampling. 

Since the overriding consideration in most Work Sampling 
programs is improvement of the work situation under study, 
a review and evaluation of the initial Work Sampling data 
quite frequently leads to a decision that observations should 
be continued, or that future studies are necessary. Such deci¬ 
sions may be reached as a result of one or more of the following: 

1. Supervision has become aware of the usefulness of Work 
Sampling as a technique for the continuous measurement of 
shop operations. 

In this case, where it is desired to continue Work Sampling 
as an aid to supervision, the initial study must be examined 
carefully. It may be that categories should be combined, that 
the time rate of observations should be altered, or that the 
degree of detail required should be changed. Note that some 
of these changes may be in the direction of simplicity, and some 
in the direction of greater complexity. The criterion here 
should be the proved needs of the supervisor. The only cau¬ 
tion necessary is that where possible the changes should allow 
the first study to be used for comparison with future studies. 

The supervisor usually is most interested in detecting 
changes in time to act , and at the same time he would like 
some means of reporting a lack of change, if that is the existing 
condition. For these purposes, use of the Chart for Category 
Proportions is invaluable. Such a chart provides a sensitive 
indicator of change, and at the same time introduces the super- 
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visor to basic concepts in statistics which will be of value in 
other phases of supervisory work. 

While use of the Chart for Category Proportions is not 
intended to be limited to supervision, a special point is made 
that the supervisor is the person best situated to take imme¬ 
diate action if operating conditions require such action. The 
Control Chart concept is, of course, useful at all levels as a 
self-reporting indicator of trends or of erratic performance. 

2. Management institutes change, and plans future studies 
to appraise the effect of such change. 

In this case, Work Sampling may be discontinued for a 
period of time sufficient to allow the changes made to take 
effect, and a separate Work Sampling study is then made. 
When such a “check 55 study is made, the results are tested for 
significance of difference of p, to determine whether or not the 
desired change has taken place. This presupposes that the 
change will be reflected in the proportions of time spent in 
specific categories. 

Details of performing the check study should be similar to 
those in the initial study, in order to make comparison valid. 
The advantage of the check study over continuous collection 
of observations throughout the change is that fewer observa¬ 
tions may be necessary. The disadvantage is that a continu¬ 
ous study will indicate the trend of improvement, and enable 
proved Control Chart techniques to be used. 

3. It is decided to investigate the nature and extent of yearly 
or other long-term cycles. 

In these cases, a company may be aware of certain seasonal 
or long-term cyclical variations in its business. For example, 
if the initial Work Sampling study has been taken during an 
“average 55 month, it may be desired to take supplemental spot 
studies of a “busy 55 month and of a “slow 55 month. While ihis 
is sound practice, an even better solution might be to take a 
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series of shorter studies, perhaps one every month. In this 
way a better concept of the entire cycle could be gained, and 
the Control Chart technique could be applied. 

While the above uses are quite common, they are by no 
means definitive of all the follow-up methods used to exploit 
Work Sampling. Once the technique has been established 
and an appreciation gained of the Control Chart and signifi¬ 
cance of difference of p tests, Work Sampling becomes a very 
versatile tool. It is quite literally true that only the imagi¬ 
nation limits the uses to which Work Sampling has been put in 
appropriate work situations. Reference to the Bibliography 
is adequate proof of this point. 

To summarize, it is usually advisable to follow the initial 
Work Sampling study either with a continuation of observa¬ 
tions or with a separate series of similar studies. This is true 
because of the ability of the technique to reflect stability or 
trends of activity and to determine the presence or absence of 
change. Most management activity is directed toward con¬ 
trol and improvement. The statistical techniques outlined in 
previous chapters, when used to analyze Work Sampling data, 
provide management with the tools to exercise control and to 
measure improvement or change. Most change takes place 
over a period of time; for that reason Work Sampling must be 
extended to encompass this time. 
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Selling Work Sampling to Others 


Why Is It Necessary to Sell Work Sampling? 

No apology should be necessary for the use of the word 
“selling. 55 The hard fact of business and industrial life is that 
many worthwhile endeavors have failed because they were not 
presented aggressively and in a positive manner. Many exec¬ 
utives actively cultivate the practice of placing the burden of 
proof on those who propose change. This is healthy, unless 
carried to extremes. For if a new technique, such as Work 
Sampling, is worthwhile and applicable to a particular situa¬ 
tion, certainly it can be presented as an attractive alternative 
of management action. 

The word alternative is used above because it must never 
be forgotten that most managements feel that not to change 
may itself be a very reasonable course of action. A prudent 
management’s natural desire for thorough appraisal of new 
techniques must not be dismissed as that old reliable whipping 
boy, “human resistance to change. 55 Rather, opportunity 
should be sought to prepare an honest and complete presen¬ 
tation of Work Sampling as it is intended to be applied, 
and management’s appraisal should be solicited on this 
basis. 

Ultimately, the success of the study will depend upon the 
support of management, and the cooperation of all who are 
involved in the study. This support and cooperation must be 
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promoted by a form of selling. It does not exist prior to the 
study, and yet it is vital to success. There is nothing unusual 
about the need for selling. Every company sells its products, 
individuals sell their ideas, and management sells other 
employees the concepts of systematic operation and improve¬ 
ment. Indeed, to institute Work Sampling without an honest 
attempt to sell its merit to all concerned would be negligent in 
the extreme, and would minimize the worth of the technique, 
and the probability of successful application. 

Who Are Others? 

Everyone concerned with a Work Sampling study is entitled 
to a clear explanation of the technique. Management, super¬ 
vision, union officials, and those being observed all have a 
stake in the proper conduct of Work Sampling. The degree 
of detail discussed, the extent to which statistical theory is 
explored, and the manner of discussion will vary from group 
to group. However, all discussion should be consistent, and 
all questions concerning technique should be answered to the 
satisfaction of the personnel involved. 

No one is so naive as to expect immediate and enthusiastic 
acceptance of any analysis or measurement technique by every¬ 
one concerned. On the other hand, honest objections must 
be considered. Once a decision is reached to go ahead with 
a Work Sampling study, every effort should be made to do 
the job properly. It is to be expected that some misgivings 
will be present at the start of the study. It is the task of those 
conducting the study to overcome such skepticism in the course 
of the study. Given a fair trial, Work Sampling has in the 
past proved to be a technique which makes believers out of 
skeptics. But to obtain this fair trial, Work Sampling usually 
must first be sold to all concerned. 
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Selling Work Sampling to Others 
A Few Words of Caution 

Work Sampling is an objective analysis and measurement 
technique which offers unique advantages through its use in 
the proper situations. But it should not be used indiscriminately. 
It is better to start with a limited application under favorable 
conditions than to attempt sweeping coverage without ade¬ 
quate experience or manpower. Acceptance will be gained 
through satisfactory results. Therefore the first study particu¬ 
larly should be done with extreme care, and objectives set 
which not only demonstrate the unique advantages of Work 
Sampling, but which can be met in a satisfactory manner. 

As a corollary to the above, do not try to make Work Sam¬ 
pling “all things to all men.” Work Sampling has proved to 
be quite versatile, but is best suited for the uses given in pre¬ 
vious chapters. While Work Sampling can be used for highly 
repetitive tasks, it probably is not as suitable as the sole analysis 
and measurement tool for such jobs as other work measure¬ 
ment techniques. There are, however, many situations m 
most companies for which Work Sampling is uniquely suitable; 
do not make the mistake of distorting the basic simplicity of 
Work Sampling m order to provide coverage in any and all 
tasks. No technique can do this. 

The previous paragraphs really are introductory to the fob 
lowing basic caution: Work Sampling is a sound technique 
which has many inherent advantages. There is no need to 
oversell it by making extravagant claims. Management and 
employee alike have had enough experience with work analysis 
and measurement to know that if there were a quick and easy 
solution to their particular problem it would long since have 
been discovered. Therefore, emphasis should be placed on 
the gams uniquely possible through Work Sampling. No apol¬ 
ogy need be made for the fact that to be effective Work Sam¬ 
pling must be done properly, and must be supported. Man- 
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agement already knows that “you can5t S et something for 
nothing. 59 The selling job consists of presenting Work Sam¬ 
pling in its proper light, so that management can make an 
intelligent decision pertaining to its use. 


How to Sell Work Sampling 

We know that each of us is guided by his own experiences, 
and by his present job demands. It follows that every person 
concerned will examine and appraise Work Sampling m a 
slightly different light. The general manager and the fore¬ 
man both may ask, “What’s in it for me?” The type of 
answer that each seeks will be different, however, because the 
demands of their daily work are different. 

It is up to the director of the study to discover the needs 
which a Work Sampling study might fill. He then must sell 
each group on the desirability to that group , and to the company 
as a whole, of Work Sampling. The biggest single aid to this 
selling is the ability to communicate ideas. Such communi¬ 
cation must be done in an orderly fashion, and will require 

work. 

Consider for a moment the mental state of a supervisor when 
first confronted with a proposal that he participate in a Work 
Sampling study. His first reaction takes the form of a ques¬ 
tion, Why? His next reaction is another question. What is 
Work Sampling? Therefore, the first step in selling Work 
Sampling, like the first step in doing Work Sampling, concerns 
the objectives to be sought. 

To take things in order, management will have to be sold 
first of all. Since the need for the study usually originates 
with management, the preceding discussion should suffice as 
a guide to the business of gaining management acceptance. 
In the case of the supervisor and foreman, the objectives can 
best be explained by higher line supervision. This might be 
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done as an introduction to explanation by the director of the 
study. In brief, the foreman or supervisor wants to be assured 
that his boss supports the study and that the objectives are 
practical. 

The setting of specific objectives has been discussed. But 
while all groups may be aware of the general need for, say, 
cost control, the actions taken by each group to achieve this 
will differ. Also, top management needs information in a dif¬ 
ferent form and degree of detail than does line supervision. 
Finally, the personal participation required of each group will 
vary. Therefore the objective “improve cost control” must 
be translated into a series of particular reasons why this is 
desirable, and how a Work Sampling study will help. 

Once the “Why?” has been answered by management, the 
director of the study should undertake the explanation of 
“What is Work Sampling?” The exact approach here will 
vary. In general, the organization of material of this book 
may be followed, tailored to fit the situation. The following 
suggestions may be of value: 

1. Be sure that your presentation is logically arranged and 
that new expressions are explained as they are introduced. 

2. Prepare each session for the particular group involved. 

3. Going back to the objectives previously explained by 
supervision, show where the data obtained in the study will 
be of value to management and employee. 

4. Relate general case given in text to the particular 
application under discussion. 

5. Emphasize the flexibility of category definition and the 
selection of observers and pattern of rounds of observation. 
Work Sampling has many “do-it-yourself” aspects. 

6. Prepare visual aids and notes appropriate to the 
group. 

7. Secure management’s agreement to hold uninterrupted 
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sessions of instruction. The few hours’ training time should 
not be broken into by odd calls for the participants. 

8. Emphasize the economic balance between information 

obtained and time spent in study. 

9. In brief, show the fact-finding nature of Work Sam¬ 
pling. This aspect, rather than traditional time-study 
approach, has proved to be most attractive. No matter what 
the preconceived ideas of work measurement, everyone prefers 
to operate from facts. 

10. Consider it essential that questions be welcomed, and 
try to obtain participation in deciding upon the details of the 
study. 

11. Always keep in mind that the success of the study 
depends upon the quality of the initial observations. This in 
turn depends upon the motivation and proper instruction of 
the observers. 


77 


Cose Study A: 

Office Activity in Preparation 
for Data Processing 


Statement of the Problem 

A medium-sized soft-goods manufacturing concern was 
planning to introduce an electronic computer and mechanized 
data processing to its entire paper-work system. Manage¬ 
ment sought a reduction in clerical cost, more rapid flow and 
better availability of information, and better sales and pro- 
duction information. 

As a first step, the present system was analyzed, starting 
with the order and billing department, which received all sales 
orders and controlled the finished goods inventory. This case 
problem describes the Work Sampling study made in the order 
and billing department. The formal report issued at the con¬ 
clusion of the study is used here in its entirety, and supple¬ 
mental exhibits are included to supply necessary detail. Since 
this was the first Work Sampling study done in the company, 
the formal report was originally written to serve as a 

guide for other supervisors in the conduct of succeeding 
studies. 

Twenty-one employees were studied. All personnel were 
located in the same large office, and all work positions were 
easily visible from the desks of the supervisor and his assistants. 
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MEMO 

April 29, 1955 


TO: ALL PERSONNEL OF THE ORDER & BILLING DEPARTMENT 


WE NEED YOUR HELP! 

At the present time the company has commissioned Mr. 
Heiland and Mr. Richardson both Professors of Industrial 
Engineering at Lehigh University to make a study of the 
company operation. These men teach a full load at Lehigh 
then work a day or so in at the plant. 

The question asked these men by management is in part "Can 
we utilize any of the Electronic advances in our company? 


To boil this down they are studying the possibilities of 
the use of a "Univac". The "Univac" is an electronic com¬ 
puting machine which has a memory where many figures may 
be stored. The study is being made in order to be able to 
advise the company whether or not the large expenditure 
for one of these electronic marvels is justifiable. 

This brings us down to our small part. In addition to the 
information you gathered on the number of rolls by color 
and width sold since January 1953, they want us to parti¬ 
cipate in a "Work Sampling Study". First let me belay 
any fear that this is on a personal basis. IT IS N0T1 Let 
us define Work Sampling for you: 

"Work Sampling can be used in an office for the quanti¬ 
tative analysis, in terms of time, of the activity of 
people, equipment or any other observable state or con¬ 
dition". This is a mouth full and actually means that it 
is a study to find the Peaks and the Lows in the work 
flow. 

The actual study is made by taking eight Random observa¬ 
tions each day of activity of the department. "Randomness 
is the statistical sampling of conditions at any given 
instant of time. The actual observations will be taken by 
myself. Bob or Al, no outsiders. We will then break the 
conditions into the following: 

Fig. 11-1 



Case Study As Preparation for Data Processing 

Writing Operations 

Handle Papers 

Operating Office Equipment 

Telephone 

Conversation 

Filing 

Walking 

Absent 

Absentee 

Other non-working 


f^ er , a Period of time whioh is set by the men of Lehigh 
the observations are summarized and compiled into a chart 
used to compare working habits of this company with others 
in industry both actual and theoretical. 


Any questions you have please ask them and we will try to 
give you an answer or get you one. 


Thanks, 


John J. Patterson 

TTn/ .. Order & Billing Dept. 

J Jr/ah 

Fig. 11-1 ( Continued ) 

There was no union in the office. Management gave strong 
and continued support to the program. The supervisor and 
his assistant acted as observers. The director of the study was 
an assistant controller who had been with the company for 
11 years. His background was in accounting and manufac¬ 
turing records. He had no college work in statistics. He 
was regarded as a most promising employee and was respected 
by his fellow workers. He had available the services of 
consultants who had been brought into the company to help 
the over-all installation of the new system. 

The study was announced to the order and billing depart¬ 
ment personnel orally, and also through a memorandum (Fig. 
11-1). No adverse reaction was experienced. The observa¬ 
tion sheet used in the study is shown in Fig. 11-2. A control 
chart used to check randomness of observation times is shown 
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in Fig. 11-3. Other details of the study are contained in the 
formal report of Work Sampling in order and billing depart- 
ment, which follows. This report is given in the form in 
which it was presented to management. 


DATE. 
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OBSERVER. 


ACTIVITY KEY 
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REMARKS:_4 


_ 1 Writing operation 7 Absent 

2 Handle papers 7A Absentee 


( 1 ) 

Control clerk 
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Stock records 
(3) 


ASSIGNED DUTIES Key 
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Invoice clerk 

( 8 ) 


3 Operate officeeqpt 8 Other nonworking Customer corr. 

(4) 


4 Conversation 

5 Filing 


T Use telephone 
- in any group 


Filing clerk 
(5) 

Teletype 
r . ( 6 ) 
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( 11 ) 
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* Job actually on at time of check. 

Fig. 11-2. Work Sampling observation sheet. 

WORK SAMPLING IN ORDER AND BILLING 

During the month of May, and again for a week during June, a 
work sampling study was made of the Order and Billing Depart¬ 
ment. May was considered to be a typical month, and the third 
week of June (just before the Chicago Show) was considered to be a 
“slack” period. In addition, a one week’s check study will be taken 
in August, at a time generally considered to be a “busy” period. 
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Thus, we hope to establish the “usual” distribution of time required 

BilW h J °, b ; n, d t0 ChCCk thC eXtremeS ' Since ° rder and 
ng should fohow the semi-annual pattern of our business, it is 

realized that there will be “slack”, “usual” and “busy” periods- the 

work sampling should establish the nature and extent of the work- 
load variations. 

At the outset, it should be stated that the Order and Billing 
Department employees should be congratulated for the interest 
which they have shown in the study. From all indications, they 



8 " 9 * 3045 ,o " **V r * r *7 rmr 7 

P 3 M 4 5 

* Control limits set at C + nr or „„ 

^ C • or 95 Per cent confidence interval 

OTder Ld bUHn F °d Ghar t t USCd a° ° heCk randomness of Sampling study in 

order and billing department, April 29 to June 17, 1955. 8 7 

2 — rounds of observation s 

32T intervals of 15 minutes * 6,22 

n , . J° tal man -observations = 199 X 21 people = 4 179 

Conclusion: Equivalent and representative coverage of entire workday. 

have cooperated very well. This is particularly true of the super- 

visors, who also acted as observers. 

The purpose of this report is to review the results of the study, and 
to formalize the procedure for future reference. Therefore the 
entire procedure will be broken down into the necessary steps; these 

can be used as a guide for check studies, and for studies in other 
parts of the organization. 

I. Objective-The objective of this work sampling study was to 
determine the proportions of time doing specific types of work by 
the various members of the Order & Billing Department. Put 
another way, the objective was to classify all work done into broad 
simple categories such as writing, handling papers, etc., and to iden¬ 
tify with each job the specific pattern of activity necessary to perform 
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the job. The ultimate objective was to prepare for the introduction 
of a high-speed electronic computer. 

General Comment—The need for a meeting of the minds among 
supervision, observers, and management prior to work sampling is 
obvious. In future studies, be certain to come to an understanding 
of objective before you do anything else. 

II. Specific planned uses—• 

1. To help establish the nature of the work done in Order and 
Billing. This is important, because there are many things a machine 
cannot do, such as take an order over the phone, exercise judgment 
in the allocation of stock, or, in general, think. 

2. To help the supervisors; first, by giving them a means of getting 
fairly precise information concerning work activity, and second, to 
accustom them to thinking in terms of the law of large numbers. This 
last will be of particular importance with the advent of any computer. 

3. To determine the nature and extent of cyclic or peak load con¬ 
ditions, as reflected in observable activity. This already has been 
covered in discussion, but the fact remains that every office is subject 
to work load fluctuations, absenteeism, vacations, special jobs, etc. 
Thus, most offices have a cyclic condition, and the office force meets 
peak loads by working harder. As a corollary, most offices simply 
relax slightly when the work load drops. This is to be expected, 
and is quite normal. But for planning and supervision, the nature 

and extent of the cycle should be known. 

4. To aid in economic analysis of equipment needs. This par¬ 
ticularly applies to the substitution of a file of punch cards as an 

adjunct to the use of the computer. 

General Comment—These uses are presented in the order in 
which the information will become available; as we obtain more 
observations, we gain greater reliability. 

III. Designation of Categories of Activity-In Order and Billing, 
it was decided to separate the work into categories as follows: 


1. Writing operation 

2. Handle papers 

3. Operate office equipment 

4. Conversation 

5. Filing 


6. Walking 

7. Absent 7a. Absentee 

8. Other (Nonworking) 
T—Use Telephone 
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It was felt that these categories would provide the information 
considered necessary to meet the objective. Further, these met the 
generairequirements in that they were (a) Easily recognizable by 
sight (b) Capable of fairly precise definition, and (c) Consistent 
with the end use of the study. By this last is meant that categories 
o ac lvity could be matched with the performance of specific jobs 
«« In addl ‘ lon t0 *e categories of activity, a list was made of 
assigne uties, ’ which enabled the observer to identify specific 
jobs, even though, because of absenteeism, work load variations, etc. 
the personnel on the jobs might shift around. This list of “assigned 
duties was as follows: 5 


7. Invoice Clerk 

8. Checker 

9. Recap Clerk 

10. Auto Stock Clerk 

11. Stenographer 


1. Control Clerk 

2. Stock Records 

3. Customer Correspondence 

4. Filing Clerk 

5. Teletype 

6. Secretary 

I V. Selection and Training of Observers-This proved to be a rela¬ 
tively simple step. The Supervisor and Assistant Supervisor acted 
as observers. They were extremely familiar with the activity, were 
in a good physical location to make observations, and most impor¬ 
tant, were willing to undertake the job and had the intellectual curi¬ 
osity to try something new. The objectives, theory, and possible 
pitfalls were outlined to them, and two afternoons were spent in 
gnuig over the methodology. In addition, someone experienced in 

Work Sampling looked over their shoulders” while the study was in 
progress. 7 

V Announcement of work sampling program-Here an outstanding 
job was done. The announcement (attached) took the form of an 
open letter to the Order and Billing Department, and every effort 
seems to have been made to be as open and honest as possible. 
Whether a written announcement is made, or verbal notification is 
considered enough, it must be emphasized that the people being 
observed should be informed. P P g 

VI. Design of Forms— 

(a) The observation sheet (appended) is an example of one of the 
forms necessary. The particular arrangement is not necessarily 
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standard. Number of categories, number of persons or machines 
observed, etc., will influence design. If punched cards are to be used, 
or if observations are to be punched later, this too must be considered^ 

(b) Summary Sheet (enclosed)-Any convenient means of 
summarizing data, by function, category, etc., will do. 

(c) Graphs of results-These are extremely helpful m presenting 
results, and will be discussed later under “results.”. 

VII Randomization of Times-It is of extreme importance that 
the times of observation be random. “Randomness” means simply 

minute has an equal chance of selection as the ttme of observation 
as any other minute, and that the entire period desired to be covere 
* c0V ered. In this case, it was decided to make one observation per 
hour. A table of random numbers was used, and numbers between 
00 and 59 (inclusive), were selected as they occurred. Thus, if he 
numbers in the table were 923640719 , etc. the first observation 
would be made at 8:23, the second at 9:40, the third at 10.19, and 
so forth It might be added that in the mill only five observations 
per day were made, and thus, three digit selections were made. 

By randomizing times, a systematic error (such as would occur if 
observations were taken “on the hour”) is avoided. By taking a 
large number of readings, it is possible to coyer the entire cycle, and 
thus minimize errors inherent in any sampling procedure. 

VIII Making Observations—All that was required o t e o server 
(supervisor, in this case) was that he be conscientious in making 
observations at the random times selected, and that he classify into 
the proper category whatever activity he observed at the instant of 
observation. The observer did not try to anticipate or “second guess 
activity. If he missed a round, or was late, he noted this on the 
sheet. Care was taken to indicate absentees, etc., so that the study 
could be used with confidence. 

IX. Results—The best way to discuss the results of a work sampling 
study is to go back to the objectives of the study, and appraise the 

extent to which these have been met. ir t 

(a) To establish the nature of the work done in Order and Billing. 
This is shown graphically in the large chart labeled “Distribution of 
Work Sampling Observations.” In total, the time distn ution was 

as follows: 
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Writing 

Handle Papers 

Operate office equipment 

Conversation 

Filing 

Walking 

Absent & Other (not work) 


26.5% 

39.6% 

4.4% 

10 . 6 % 

5.9% 

4.1% 

8.9% 


The overall only serves to indicate that the personnel in the 
department are conscientious, and that the supervision is capable. 
The chart shows distribution of activity by groups, and is therefore 
the most meaningful form of presentation. 

In general, the work sampling supported the subjective opinions 
e y the supervisors. The supervisors found no obvious errors 
or discrepancies. But for purposes of comparison at a later date 
and because the study “put a number” on the proportions of activity, 
the study is valuable. Now the supervisors know (quite precisely 
m the major categories) just how much of each activity occurs. 
This makes possible planning and will provide a bench mark to 
guide methods improvement. 

(b) To determine the nature and extent of peak load or cyclic 
conditions—This was done by charting the data by groupl by 
per cent of each category, along a time axis. Examination of the 

were^lT r< d Veal the fluCtUations in categories. The supervisors 
we e able to draw meaningful conclusions from these charts, which 

will not be dealt with here. It is sufficient to say that an expected 

“slack” n U e d f* “ materialize du ring the normally 

slack period selected for a spot check, that some slight cyclic 

trend seems apparent, and that the present policy of Ly- 

lmplo P yee OVertime See ” S “ preference to hiring a new 

(c) To aid in economic analysis of equipment needs-For this 
purpose the study revealed the possible gains in each area. For 
instance, all walking consumed only 4 . 1 % of the time and all 
operate office equipment” consumed 4.4% of the time. While 
this w by no means indicative of the overall importance of these 
activities, it seems obvious that if we could cut “operate office 
equipment” and “walking” time in half through a different office 
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layout and newer equipment, we still would save only at* . 4% 

of the total time. On the other hand, if we reduced handle papers 

by only ten per cent, we would achieve about the same: savmgs 
Thus the study concentrates attention first on the areas of greatest 
potential saving. Most important, we can now appraise improve- 

merits in terms of dollars and cents. .. 

Reliability of study—Without going into too much detail, we can 
be sure 95% of the time, that the overall “handle papers propor- 
«H be 38% >nd 41.3%, provided » ohanje 

has occurred in the office. This high reliability is due to the fact 
that a total of 3,810 observations were taken. For the indivi ua 


20,000 


80,000- 



I Control I Secretary 4 Invoice 

clerk 1 Stenographer clerks 

I Recap I Teletype I Checker 
clerk operator 

) Auto carpet 
clerk 


3 Customer 5 Stock 
correspondence record 
clerks clerks 

I File clerk 


Entire 

department 


cierK 

Fig. 11-4. Order and billing department Work Sampling summary. 


groups, which make up the total, a lower reliability will be found 
Hence, the more observations the better, up to an economic linn 

of reliability. . . • r 

There is no need here to go into the mathematics of statistics, for 

the burden of calculation should not be placed on the supervisor. 
It is, however, important to remember that results depend upon the 
number of observations and the conscientiousness of the observer. 

In conclusion, it is felt that no great burden was placed on the 
supervisors, that the results will be most useful, and that the tech¬ 
nique of Work Sampling is straightforward in use, provided the 
proper attention is given to the details, and the observations made 
in a conscientious manner. 















Case Study A: Preparation for Data Processing 149 

Results 

This study revealed the amounts of time spent by various 
employees in each of the activities. These are given in the 
table of the report, and also in Fig. 11-4. From the study 
alternate cost figures could be developed. Planning for the 
transfer to punched cards was made effective, and a smooth 
transfer was made. Cost estimates proved to be accurate. 

A follow-up study showed that the seasonal cyclic effect was 
of much less importance than had been supposed. 

The Work Sampling study in order and billing was con¬ 
sidered to have met management’s objectives. To generalize 
the problem of preparation for the introduction of mechanical 
ata processing should be preceded by a sound analysis of 
system, personnel, and cost requirements. In clerical work 
particularly, Work Sampling has proved to be an effective 
means of work measurement for this purpose. 
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Engineering Design and Drafting 


Statement of the Problem 

A large engineering design section, in the chemical-petro¬ 
leum type industry, was studied. This section was responsible 
for the design of process, equipment, buildings, piping, and 
electrical and structural-steel work. The design was carried 
through to the blueprint stage. Approximately two hundred 
designers and draftsmen were employed in the section. 

The designers and draftsmen were organized into groups 
on a functional basis, as indicated in the discussion which 
follows. These groups were located in seven different offices 
in four different buildings. It was felt that this separation led 
to excessive visiting and travel time. A central file and blue¬ 
print facility was in use. An appraisal of this arrangement 

was desired. 

The fundamental problem facing management was that the 
work load was increasing and that experienced designer- 
engineers were difficult to recruit. A number of alternative 
solutions were under consideration. Management suffered 
from the lack of specific knowledge of the activities performed 
by the designer-engineers, in terms of time. Among other 
things, it was desired to secure some measure of the following. 
150 
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1. Time spent by various designers in groups other than 
their own 

2. Time spent in sketching and planning work 

3. Time spent in routine detailing and drawing 

4. Time spent in discussion and consulting 

5. Need for blueprints and blueprint service 

Background of Problem 

For a number of years the company had been doing all its 
own design work. The forecast was for increased volume, but 
the type of work was changing to require more special skills. 

he company had been considering the alternative of “letting 
out” some design work to an outside design firm. It also had 
the alternative of requesting more design work from various 
vendors. The long-range solution to the dispersion of the 
present design force was considered to be a new building. But 
this was at least two years away. 

The design section was organized into 12 groups. As 
shown on the summary chart of observations, the groups varied 
m size and in function. The chief draftsman had organiza¬ 
tional and administrative responsibility for all groups. The 
groups were as follows: 

Architectural—4 men 
Equipment—9 men 
Instrumentation—6 men 
Electrical—26 men 

Piping—Four groups of 15, 29, 20, and 12 men 
Structural steel—Four groups of 8, 13, 9, and 6 men 

Each of these groups was headed by a supervisor, or group 
leader. The larger groups had assistant group leaders. The 

only measure of production was square feet of blueprints 
produced by each group. 
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Why Work Sampling Was Used 

The fundamental reason for the use of Work Sampling was 
that management felt that in dealing with a group of salane 
men of technical background, time study or predetermine 
work times might result in unfavorable personnel relations. 

In addition, since thinking and creativity were involved at 
least in part, the conventional “umt-of-work” approach of 
these techniques was not felt to be suitable. 

Work Sampling by group supervisors would at least ensure 
acceptance of results by these supervisors. The expense wou 
be quite small, and such a study would give management some 
frame of reference to help in making a choice among the alter¬ 
natives. Management’s objectiv es w ere first, to measure 
observable activity ^immediate decision, and second, to seek 
concrete indications of possibilities for improvement of the 
present situation. 

Finally, there was no generally accepted means of measure¬ 
ment of design work. The common attitude was that the 
work was not capable of being measured by other than sub¬ 
jective means. The chief draftsman felt that while this might 
be true for that part of the men’s activity which involved cre¬ 
ative thinking, it was not necessarily true of the actual mechan¬ 
ical work connected with design and drafting activity. He 
felt that no harm could be done, and could see possibility of 
gain. While this seems to be a weak statement of purpose, it 
must be remembered that Work Sampling was new to the sec¬ 
tion and that no work measurement had ever been attempted 
there prior to the study. 

Organization for Work Sampling 

The responsible top management of the section had insti¬ 
tuted plans for the study, and had displayed an active interest 
throughout. Weekly reports were given them, and the chief 
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draftsman let it be knnxAm + u 

interested in the results. ^ mUch 

haJ 1 tf reCt0 ^ 0fthCStUdy WaS “ 0ffice m ethods analyst who 

had a h” ^ SCCtion for sev eral months. He 

ad a business degree, and four years’ company experience 

He was fanuhar with Work Sampling through a company 

suhamfto t° gram WhlCh ° CCaSi0naliy em Pi°y e d outside con- 
tants to tram m special techniques. One such training pro 

zz*T m i Tr k Sampiias - wa, «h» j ,r; 

he had supervised, although he had assisted in one large-scali 
study for the parent company. g * 

Group leaders agreed to act as observers. This was done 

because the extra expense of special observers was undesirable 

and because the chief draftsman felt that better accept 

e gained m the drawing rooms if the men observed 
were familiar with the observers. observed 

In the discussion with the group leaders, it was brought out 
that the group leaders felt that the purposes of the study did 
not reqmre that individuals be identified They said 

that the men would accept the study better if it could te 

fheTdy OU Th ‘ n ° indiVidUaI C0M bC PCnaIiZed aS a —h of 

g oup leaders alone knew the code. 

Selection of Categories 

The categories were selected at conferences of the group 
leaders, the director, and the chief draftsman. These cate y 
g ues are shown on the observation sheet (Fig 12 1 ) o 1 

Category 4, Consulting, was defined as “two or more of * 

s«b^ *;r <P ? UP talk “ g t0 ^ her ’ m atter what the' 
ject conversation seemed to be.” While some thought 
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that it would be “obvious” if baseball rather than design was 
he subject of conversation, it was felt that a more objective 
and reliable set of data would be obtained by treating all con¬ 
versation the same way. If the group leaders desired to exer¬ 
cise any subjective judgments, this should be done mdepen - 
ently of the study categorization. 

cLgory 7, A»ay tarn T.He, »a. de«„*d a, “no, >.»>>>«, 
i. group; if a man to »n~l,i»g in another group he ahali 


Activity Key 

1. Drawing 

(a) Layouts or sketches 

(b) Formal drawings and sketches 

2. Calculating 

(a) Design 

(b) Estimating 

3. Working on blueprints 
(a) Company 

{b) Vendor 

Timp, Cvde of Observations Was Begun 

—i—i—I I H 


6 . Preparing B/M’s 

7. Away from table 

8 . Telephone 




LLJ>^ — — . , . 

Fig. 12-1. Work Sampling observation sheet. 

be classified as away from table. This category also might 
include personal visits and all other causes of 
point here is that subjective evaluations such ry 

absence” were avoided. While some detail was lost, th 

readings were consistent. 

The title of category 9, namely, Idle, was pooriy chosen 
No group leader wanted to state that a man was Idle. Th, 
represents a mistake in procedure, and resulted in a sma 

human relations problem. By the time it was discovered, 

. . . tl.- of the director. 
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Mechanics of Work Sampling 

The procedures used to perform the Work Sampling were 
qut e straightforward. The group leaders were trained/the 
study was announced, times were randomized, and seven or 
eight observations per man per day were taken. No obser¬ 
vations were taken during the scheduled coffee breaks 
Because of the fact that the first three categories (Drawing, 
lculatmg, and Blueprint Work) required more detailed 
information than could be gathered at a glance from the group 
eader s desk, a unique method of observation was used The 

group kad ^ the initiaJ categorizadon of activityfrom 

h^Sd fi ThlS WOuldbe = for -ample, Drawing. Then! after 

he h ad fi mshed hls round Qf observadons ^ woujd ^ 

desks of men who had been observed in one of the first three 
categones and gather the additional information. Since the 

rlZrTr' 1Zati Z h3d bCen CStablished ’ the men wdconted 

Z*ll st T7 nt< , visits - There was generai c <™t 

at the study forced group leaders to communicate more with 

di 7 T 0 ; a r/ ( ; bcc T e more aware ° f ^ w ° rk ea <*— 

■ Both felt that this was desirable, in that it bettered 
communication, and made the study seem less mysterious. 

Results 

of’12-1 on analysis 
' mp lng percentages by categories. In addition 
it was found that no significant differences existed from week 
to week m the major categories. The study was done for a 
period of three weeks. No cycle was evident. It was quite 
pro a e t at a seasonal cycle existed, but management was 
willing to accept the relatively short three-week study 
Observation times were tested and found to be random 

The most significant items of information gathered from the 
study were as follows: 
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Table 12-1. Analysis of Work Sampling-Percentages by 

Categories _ 


Group number . 

1 

A 

2 

E 

,1 

I 

4 

El 

5 

P 

6 

P 

7 

P 

8 

P 

12 

9 

S 

10 

s 

li 

s 

9 

12 

5 

6 

No. of men in group. 
Category: 

1. Drawing 

4 

9 

6 

26 

15 

29 

20 








(a) Layout or 

12.5 

7.4 

30.4 

9.6 

2.6 

13.2 

3.4 

6.5 

1.3 

3.1 

1.0 

9.3 

(10 Formal draw- 

22.5 

39.8 

2.8 

40.0 

49.0 

35.9 

37.6 

31.7 

48.2 

43.3 

30.4 

22.9 

2. Calculating 


4.6 


1.2 

4.4 

1.7 

0.3 


7.4 

13.2 

4.8 

12.7 


0.5 






1.1 


1.0 




(6) Estimating. . . 
3. Blueprint work 

3.8 


3.4 

9.5 

15.2 

26.2 

3.7 

2.4 

13.5 

25.0 

24.7 

7.9 

(a) Company. 







(6) Supplier (ven- 


4.1 


1 1 

1.0 

1.1 

0.7 

0.2 

3.6 

1.6 

4.6 

2.3 

(Jot}.. 

1.0 


1 ♦ 1 



16.7 

20.7 

t m rt 

1 A A 

29.3 

13.5 

A onl CF ..... 

24.6 

21.5 

1.2 

26.7 

19.7 

17.2 

17 .o 

XU . o 













5. Reading and ref- 
erence 

6.4 

4.4 

0.3 

! 5.1 

1.6 

2.4 

1.4 

2.3 

5.8 

; 2.6 

0.5 

2.2 

6. Preparing bills of 




1.3 



1.0 


0.7 

' 0.1 


7.7 
! 0.5 

material. 

7. Away from table.. 

19.7 

' 9.5 

13.1 

L 5.3 

7.2 

1.0 

8.0 

0.6 

8.4 

1.0 

10.8 

2.0 

7.E 

0.{ 

) 8.5 

5 0.3 

4.1 

0.2 

o r Prt1i^TvVij'Ynp! . 

2.3 

; 1.6 



22.1 

3 A 

3 2.8 


4.1 

C), X . ... * 

q idle . 

2.e 

i 3.3 

... 

4.8 

3.9 

4.6 

2.2 


No. of observations 
Total 15,735 . 

. 391 

892 

650 2,48 

1 

5 1,541 

} 3,04: 

1 2,00< 

D 1,07' 

1 825 l,340j 930 

558 


1. Approximately 40 per cent of the time of the piping 
and structural groups was spent in formal drawing or 


sketching. 

Comment: A large part 


of this could be done by less skilled 


personnel. 

2. Approximately 30 per cent of the time of all groups was 
spent in conversation or away from the table. 

Comment: Reorganization into composite groups might 

reduce this figure substantially. 

3. Relatively a small amount (2.0 per cent) of the time was 

spent working on supplier or vendor prints. 

Comment: It had been thought that this was much higher. 

4. Very little reading or reference work was done. 

Comment: Several duplicate sets of reference books were 

maintained at some expense. It seemed that some of these 
could be eliminated. 
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Action Taken and Final Appraisal 

As a result of the study, management reorganized the section 
into composite groups, to reduce travel to specialist groups. 
Also, semiskilled personnel were hired to do much of the rou¬ 



tine drawing. This enabled the section to increase its out¬ 
put without hiring new and “hard-to-get” designer-engineers; 
A better system of supplying and coding blueprints was 
devised. 

At the end of six months, it was estimated that the above 
changes had saved $100,000 over the cost of expanding the 
design section, or subcontracting for the increased design 
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load. No personnel difficulties were experienced in the 
reorganization. 

In appraising the study, it must be kept in mind that this 
was the first use of Work Sampling in the section, and the first 
instance of formal measurement of design activity with which 
the participants were familiar. Still, management felt that 
its objectives had been achieved. 

There were a few instances of poor technique in the conduct 

of the study. These were: 

1. Use of Idle as a category. This has been discussed, but 
it did lead to a few questionable results. 

2. No measures of production were considered practical. 
A program for evaluating complexity of work was undertaken, 
but was not used in the study. Subjective opinion was relied 


upon. 
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ion 


The Problem 

floor^n° f AmenC f S manufacturer s °f hard-surfaced 

Work slmT’ “ “ g lmoleum > and corkboard, used 

diffic It ^ 40 ° btam a bCtter graSp ° f a ver y old and 
fficult problem: How effective and efficient is our main- 

tenance and construction work? 

As in many other process and semiprocess industries this 
company noted with mixed feelings the tendency of maint 
nance costs to become larger and larger in proportion to dC 
labor cost, as more and more mechanized and automatic proc- 
esses an improvements were made. It seemed as though an 
provement m direct-labor cost through increased efficiency 

usually through more complex equipment, had the effect of 

add.. 8 one , ti „ ed nechanfc for e „ ch * 

ten direct-labor (production) employees. Since mechanics’ 
wages were, and are, substantially higher than unskilled direct- 
labor employees, the effect seemed to be to rob the improve 
ment of a substantial share of its nominal saving. 

ing anTauto° that the savin & s involved in mechaniz- 

cov^the incT S ^ *** ™ than 

measured d T mai «tenance costs. But in the absence of 
day-work standards, the management has little pro- 

1 59 
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tection against a creeping increase in 
difficulty of supervision in planning, an gen 

of all costs incidental to maintenance. Dro blem of 

In addition to this factor, there was and is the problem 
control of costs in major construction work, which m this plan 
is done almost exclusively by the company’s own construct 
worker. In many cases, since both 
struction work are done by the same mechanics d 
times much poor planning and resulting high costs can res 
“ i major problem here was the difficulty in estimating o 
determining exactly how the mechanics' time was being spent. At 
first blush, this may seem to be simply a matter of reviewing 

time cards and cost reports, but most management and near y 

• Vio Vi a ve ever had much contact with 

all industrial engineers who have ever haa 

this problem are aware that time cards do not tell this stay 

This is true for a number of reasons, not the least of whic i 

the sheer inability of any human intellect to grasp the proble 

£££ and directing the work of some 600 mechanics, as 

m Maintenance personnel usually differ from most manufac¬ 
turing personnel in two important respects: 

1. They are better trained, possess higher skills, and higher 

lnteUigence^e tQ a larger measure of independ¬ 

ence and self-discipline and, usually, less supervision. 

Because of these differences, the problems of P^ning an 
control are frequently not so complex as they may appea . 
However it is llso true that there is great difficulty m evalu- 
fZTus how well planned, supervised, and controlled the 
wl really is, and in getting a grip on the actual cost-saving 

potential inherent in it. o na ce 

In this plant, there are in excess of 30 acres of floor 

and about 3,000 employees, of whom about 600 are mec am 
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Counting routine repetitive types of maintenance work, about 
4,000 maintenance and construction assignments are made per 

week! 

The maintenance and construction department is under a 
superintendent who reports to the chief engineer. There are 
about 30 foremen, reporting to 6 general foremen, who in turn 
report to the superintendent. About 400 of the 600 men are 
employed in relatively fixed locations, while about 200 are 
roving mechanics, involved in repairs, construction, and 
similar types of work. 

For about 20 years, there has been an industrial engineering 
staff attached to the superintendent of maintenance and con¬ 
struction. During the 1920s and early 1930s, an incentive 
plan based on Barth slide rules was used in machine-shop 
work, but was abandoned because of its extremely high admin¬ 
istrative costs in relation to its contribution to cost saving. No 
incentive plan has been proposed since that time, and none is 
likely to be proposed. 

Why Work Sampling Was Used 

In mid-1954, the management decided to undertake a criti¬ 
cal examination of its maintenance and construction costs, to 
be followed by a long-term (two to five years) program to insti¬ 
tute any improvements indicated, and eventually, measured 
day work. 

A brilliant industrial engineer was placed in charge of that 
function within the maintenance and construction depart¬ 
ment, and he was convinced that the objectives were valid and 
attainable. He himself was a journeyman machinist, was well 
known and highly regarded by both the management and the 
shop mechanics, and he was permitted to reinforce his staff 
with several good young engineers chosen for the pioneering 
type of spirit so necessary for the success of such a huge venture. 
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A survey of then-present conditions and efficiency was the 
first step, since management desired a detailed proposal before 
entering upon a long-range program. It was here that Work 
Sampling was used for the first time in this company. 

Work Sampling was first used, and has continued to be used, 
only as a mechanism that enables a convenient, economical 
evaluation to be made of over-all time utilization , and has not in 
itself been used as a means of appraisal of pace during actual 
work. Work Sampling was selected as the time-utilization 
yardstick for the following reasons: 

1. Its relative economy of application, as compared with 
production studies, subjective evaluation, or self-reporting. 

2. Its promise as a tool with which to obtain “team 
effort’ 5 through having line supervisors make the preliminary 
appraisal. 

3. Its ability to enable a line foreman to take an enforced, 
searching, objective look at what his own men and equipment 
were doing. 

4. Provision of a regular topic for review by general foremen 
and superintendent, in conferences with foremen. 

5. Opportunity for foremen to put teeth into their pet gripes 
about insufficient and/or inadequate manpower or equipment, 
or management planning. 

6. Opportunity to appraise the “gold in the mine” before 
embarking on a full-blown program, so that management’s 
emphasis could be directed to the more fruitful areas for 
improvement. 

7. Opportunity to accustom the line supervision and the 
staff industrial engineers to work together in improvement. 

8. Opportunity to appraise the ability and interest of line 
foremen in growth potential under the two- to five-year pro¬ 
gram to follow. 

9. Finally, the fact that observers other than the foremen 
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Work Sampling Categories 


Major 
[Code (Complete) 


Code 


Intermediate 

(Complete) 


HO I Walk empty off job area 
120 Walk loaded off job area 


130 Ride empty off job area 


140 Ride loaded off job area 


200 

Prepare 


300 

Do 


I 400 J 

Clean up - 


500 


Wait for 


600 

Idle 


000 

No contact < 


W 


K3 


\\ ,5C 

-j. ... i . ... . 1 

Walk empty in job area 


Walk loaded in job area 

AE 

Plans 

AE 

People ( 

AE 

Job site 


^j 3(0 

Attention work 

AE 

General craft work 


- 410 

Job site 


y 510 

Information 

/ 520 

Materials ^ 

^ 530 

Transportation equipment 

■" 540 

Other crafts 

S 550 

Others in same crew 

^ 560 

Production department 


r ,0 l 

On job site 

iffiL 

Off job site 


010 

Mo contoct 

020 

Partial trip 


Code 


?d3 


Minor 

(Examples on ly) I 


| 221 

Study specifications 

I s22 

Give or receive information 

223 

Put on protective 
clothing or equipment 


j 521 

From stores 

| 522 

From shop transportation 

523 

From craft shop 

-- ' ' ' • —-■ --in. 


Fig. 13-1 
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would be unable to recognize by sight 600 different men gave 
the foremen the job of observer almost by default. 

Selection of Categories 

The Work Sampling program was launched in a meeting of 
supervisors, industrial engineers, and plant management, 
where objectives were discussed, a tentative timetable was set 
up, and general agreement was reached on the desirability of 
using only line supervisors as observers. 

During the course of providing individual and small group 
instruction in the making of observations, the industrial engi¬ 
neers saw the need for development of a uniform series of cate¬ 
gory definitions. Since use of tabulating cards for compilation 
of results was contemplated, the use of standard activity cate¬ 
gories was necessary in order to have consistent results, correct 
interpretation of data, and versatility in presentation of results. 

A series of conferences by the staff industrial engineering 
group produced the category definitions shown m Fig. 13-1. 
These categories are obviously tailor-made for the use of Work 
Sampling observers in this particular situation. However, 
they have been found to fit many maintenance operations in 
other plants. 

It will be noted that code numbers are shown in Fig. 13-1. 
Major, intermediate, and minor classification codings are for 
subsidiary activity breakdowns, so that a one-, two-, or three- 
digit number may be used, depending upon the degree of detail 
desired and the number of observations contemplated. 

WORK SAMPLING CATEGORIES AND DEFINITIONS 
Code 

11 0 Walk Empty—Off Job Area * 

A. Walking empty handed. 

*Job area is defined as: that area immediately surrounding the actual 
installation and/or including a temporary work bench. 
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120 Walk Loaded—Off Job Area * 

A. Walking carrying material, tools, parts, etc., including push 
hand truck. 

i.e. Mechanic going to or from Tool Room carrying tools. 
Mechanic going to or from Graft Shop carrying parts 
or material for installation or revision prior to 
installation. 

Mechanic pushing hand truck with parts, tools, or 
material to Production Department Area, Craft 
Shop or Tool Room. 

130 Ride Empty—Off Job Area* 

A. Riding on scooter, fork truck, or shop truck. 

i.e. Gang leader or preparation man riding scooter. 
Equipment operator riding fork truck or tractor. 
Shop transfer men riding fork truck or tractor return¬ 
ing to Craft shop or Stores to obtain material qr 
parts. 

Riding in shop truck enroute to outside vendor for 
material or parts, or returning from delivering 
material to be returned, exchanged, altered or 
repaired, by an outside vendor. 

140 Ride Loaded—Off Job Area * 

A. Riding carrying material, tools or equipment on scooter, 
fork truck, or shop truck. 

i.e. Gang leader or preparation man riding scooter from 
Prod. Dept, area to Craft Shop with material or 
parts to be altered, or riding scooter from Craft 
Shop, Tool Room or Stores with material, or parts, 
to be used on installation. 

Equipment operator riding on lift truck or tractor 
from Prod. Dept, area carrying material, parts, 
tools, or scrap, to Craft Shop, Tool Room or 
Salvage Yard. 

Equipment operator and/or shops transfer men 
traveling from Craft Shop, Tool Room, or Store? 
carrying material, parts, or tools, to site for instal¬ 
lation. 

Riding in shops truck to or from outside vendor with 
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material, parts, or tools to be altered, exchanged, 
repaired, or returned. 

150 Walk Empty—In Job Area* 

A. Walk empty handed. 

160 Walk Loaded—In Job Area* 

A. Walking carrying material, tools, etc. in Job Area. 

i.e. The Calender Job, where welding table is adjacent 
to #10 Stove and work area extends to north end 
q£ building. However, the area should not extend 
to more than one building. 

Prepare 
210 Plans 

A. Look over, or pre~inspect job site or parts to determine what 
is needed and/or what is to be done. 

i.e. Gang leader, preparation man and/or mechanic 
checking site of installation, material or parts, with 
blueprints, sketches or drawings. 

Gang leader, preparation man or mechanic making 
drawing, or sketches for parts to be made or 
altered in Craft Shop. 

Gang leader, preparation man or mechanic making 
out stores requisition for material to be delivered 
to job site. 

Prepare 
220 People 

A. Study, sketches, prints and specifications, route sheets and 
procedures. 

B. Give or receive job assignments and instructions. 

C. Obtain information from other craftsmen, engineers or 
production personnel. 

D. Answer and make phone calls. 

E. Put on protective clothing or equipment. 

i.e. When gang leader, preparation man or mechanic 
peruse prints, specifications or sketches, before 
starting installation. 

Normal job assignments. 

* Job area is defined as: that area immediately surrounding the actual 
installation and/or including a temporary work bench. 
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Gang leaders or mechanics discuss peculiarities of job 
assignments relative to making correct installations. 

Prepare 
230 Site 

A. Obtain and prepare material or equipment. 

B. Set up or arrange material, tools or equipment. 

C. Set up ladders or assemble scaffolds or platforms. 

D. Shut off or lock out any service, water, electric, oil or gas. 
Hang safety tags on controls. 

E. Hang up or lay down equipment or material to protect 
surrounding areas, equipment or parts. 

F. Make room to work. 

G. Clean area in which job is to be performed before starting 
work on job. 

# i,e * Brin g material such as pumps, motors, conveyor, etc., 
from storage to site of installation. 

Hang chain block or install temporary I-Beams for 
chain blocks, set up scaffolds or ladders. 

Hang asbestos curtains for fire protection. 

Lay scrap felt on floor, grease and oil drippage. 

Move production material from area. 

Bring tools from tool box when unable to bring tool 
box to site. 

Do 

310 Attention Work 

A. Stand by for safety protection. 

B. Watch while training or being trained. 

C. Watch machine tools while operating. 

D. Watch machine or equipment to determine trouble or 
during test run. 

E. Stand by while new installations are being tried out. 

i.e. Stand by with fire extinguisher while burning or 
welding is being done. 

Stand by while work is being done in sub-station by 
craftsmen other than electrician. 

Stand by while work is being done in gaseous stoves 
or other hazardous area. 

Stand by to hold ladder while man works from ladder. 
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Stand by at sprinkler valve while work is being done 
on sprinkler lines. 

After machine has been assembled, stand by for run 
in, to check bearings, belts, etc. 

Helper stands by while mechanic does intricate part 
of work, ready to lend a hand when necessary, such 
as establishing center lines, bench marks, etc. 

Do 

320 Craft Work t . . 

A. Handle material, tools or equipment within job site. 

Including all walking within site. 

B. Gauge, inspect, or otherwise check or test work. 

C. Clean parts or equipment. 

D. Do craft work. 

E. Apply protective coating or covering on parts for storage, 
i.e. Arrange material or tools for installation. 

Take measurements of roll dia., bearings, etc. 

Wash, scrape or otherwise clean parts for reinstal¬ 
lation or storage. 

Actual work with hands, such as removing guards, 
chains, bearings, or parts of equipment. 

Paint rolls, bearings, and machined surfacing with 
protective coating for storage. 

Helper sent to tool kit (stored in work area) for tools 
or equipment essential to installation in progress. 

410 Clean Up # 

A. Aside or dispose of material, tools or equipment, including 

scrap, excluding any traveling. 

B. Take down ladders, or disassemble scaffold or platform. 

C. Put facilities back in service and remove safety tags from 
controls. 

D. Take down safety barriers or ropes. 

E. Take down or pick up equipment or material protecting 
surrounding areas, equipment or parts.. 

F. Remove protective equipment or clothing. 

G. Sweep up area and replace any items that are out of place, 
i.e. Generally police the area after job is completed. 

Gather scrap thru-out the Plant. 
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510 Waiting for Information 

From Supervisors, Gang Leaders, Engineers 

A. Job Assignments—where, what, when, 

B. Instructions—How, why. 

C. Job Approval—Changes or continuations. 

D. Job Specifications—New or revised. 

E. Other Information—Job numbers, etc. 

* i.e. Men working on job run into difficulty—put gang 

leaders call on, waiting until he arrives. 

When men are assigned to job, where verbal instruc¬ 
tion will be given by engineer or supervisor. 

After job is completed waiting for new assignment. 

520 Waiting for Material 

From stores, shops transportation, Craft Shops. 

A. Tools 

B. Equipment 

C. Supplies 

D. Parts 

E. Raw Material t # 

i.e. Waiting for preparation men to bring special tools 

from Tool Room. 

Waiting for equipment or parts to be brought from 
storage for installation. 

Waiting for 

530 Transportation Equipment 

A. Elevators, cranes, hoist, fork trucks, etc. 
i.e. Waiting for elevator. 

Waiting for lift truck. 

Waiting for crane, being used by Production or other 
crafts. 

Waiting for Shop or Yard truck. 

Waiting for outside vendors truck where something is 
being shipped out. 

Waiting for 
540 Other Crafts 

A. Waiting for other crafts to complete their work. 

i.e. Waiting until Sheet Metal men remove guards, hoods, 
or duct. 
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Wait until Electrical men disconnect motors. 

Wait until Pipe Shop men remove pipe connections. 
Wait until Carpenters build skids, scaffolds, etc. 

550 Waiting for Others of Crew 

To arrive at job site, due to unbalanced crew condition, 
i.e. When two (2) men are assigned to a job, one man sent 
to Shop, Tool Room or Stores for parts or supplies, 
or only one man can work at that particular 
moment because of nature of task to be performed 
or of limited space. 

560 Waiting for Production 

A. Release equipment. 

B. Provide space to work. 

G. Provide information. 

i.e. Change rolls, knives, parts, etc., on Calender, German 
Mixers, Dicers, etc. Must wait until last batch is 
run out before machine can be shut down. 

Move raw material stored in area where new machine 
is to be installed. 

610 Idle on Job 

While work can be done. 

i.e. Mechanic idle in work area or immediate vicinity. 

Resting while work can be done. 

620 Idle off Job 

While work can be done. 

i.e. Mechanic visiting another department for reasons not 
connected with his work. 

Personal time (lavatory, personal conversations, etc.). 

Further explanations of the major categories are shown 
above. These definitions were circulated to all observer- 
foremen, and individual practice trips were made by industrial 
engineers with each foreman on each shift in each craft, to 
make sure that each activity category was thoroughly under¬ 
stood, before actual recording of observations on a regular 
basis was begun. Periodic reviews of category definitions 
were set up with each observer-foreman. 
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The necessity for randomness was complicated by the fact 
that foremen who supervised mechanics engaged in roving 
repair and construction work were unable to complete a trip 
in less than two to three hours, and in some cases were unable 
to locate all of their men in a half day. While these extreme 
cases decreased gradually over several months of sampling, 
primarily because of better planning and more complete 
knowledge of the assignments and locations of each employee, 
the concept of randomness, under these conditions, must be 
considered in a slightly different light than is usual in Work 
Sampling. 

Randomness in Work Sampling usually is considered as 
applying to the time interval between cycles, or trips, of obser¬ 
vations, and hence a schedule for making cycles or trips can 
be set up in advance, and held to by the observer. This is 
particularly true where little or no walking is involved, and 
the cycle or trip takes not more than five or ten minutes. 

While such a scheme was used for those foremen who had all 
their employees at relatively fixed locations, such as machine 
shops, sheet-metal shop, electrical shop, weld shop, pipe shop, 
machine-erection shops, cribs and storerooms, etc., it could 
not be used for such groups as field welding, electrical main¬ 
tenance, and building maintenance. In these latter cases, 
no scheduled times were assigned, and the foreman was 
instructed to record the time when he observed each man 
each day, to the nearest quarter hour, with the randomness to 
be checked at the end of each month by a c chart. 

Several systematic nonrandom influences developed in these 
latter cases. First, the tendency of a supervisor to favor cer¬ 
tain times during the shift was noted. This was corrected by 
explanation of the serious effect this had on the reliability of 
the results. Another error was the failure to complete a trip, 
that is, failure to observe all his men on each trip, thus endan- 
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gering the drawing of inferences, since the contributions of 
individual employees to the final results were unequal. This, 
too, was explained, and the cause removed by assisting the 
foreman to avoid biasing the results. 

Taking the Observations 

A few of the forms used for collection of data are shown in 
Figs. 13-2 to 13-4. An example of the punched card used is 
shown as Fig. 5-3. While in some cases observations were 
made by foremen directly on mark-sensed punched cards 
(employees’ names and other fixed information already pre¬ 
punched and interpreted), many foremen preferred to use 
observation forms such as those shown. In these cases, tran¬ 
scription to mark-sensed punched cards was made by clerks, 

at comparatively little expense. 

Simple calculation reveals that the number of observations 
made during a month was enormous. Average number o 

trips per day steadied down to about 4. The * do ™’ 
per day, times 600 men, times 20 days per month, yields 48,000 
man-observations per month! Obviously, some mass data 
handling method, such as punched cards, was a vital necessity 
in order to carry out the program. 

Results 

The foremen acted as observers continuously for about six 
months, during which close cooperation among all involved 
in the program yielded some highly interesting results. 

Probably the most immediate benefit was the enforced, 
periodic look at each employee, by his foreman, several times 
each day. The foremen were instructed to make whatever 
method improvements seemed desirable, whenever and wher¬ 
ever they could. Many crew unbalances, unnecessary on-t e- 

job delays, and instances of poorly planned work were cor 
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rected. In the long run, this type of on-the-job method 
improvement by foremen may well be the most significant 
result of the program. 

Summarizations of results were made for each observer, on 
a weekly basis. Control Charts for each observer were set up 
and posted weekly, to reflect three phases of the results: 

1. Distribution of observations by time interval, in the form 
°f a c chart, to note nonrandom sampling influences. 

2. For each category, a p chart to reflect stability or change 
as the program progressed. 

3. A bar chart showing total observation distribution. 

These charts had their primary use as subjects for discussion 

in weekly conferences held by each general foreman with each 
foreman under him. However, they enable the engineers to 
assist in removal of nonrandom sampling influences and to 
evaluate the improvement potential. 

The question of whether foremen will bias results by deliber¬ 
ately miscalling certain categories came up very early in dis¬ 
cussions of Work Sampling. There is, of course, a tendency 
on the part of foremen to protect themselves against unknown 
uses of the data they collect, prompted by fear of retribution, 
and deliberate miscalling of observations is the most obvious 
way to protect themselves. However, this tendency can be 
dealt with, and was in this case, by use of two convenient 
devices: 

1. When deliberate bias occurs, it will nearly always be 
revealed in the Control Charts for category proportions by a 
stratification appearance in the category not being recorded 
sufficiently often, as well as in at least one other category (the 
one recorded in lieu of the correct one). Hence, since no 
change is shown on the charts, indeed an unnatural constancy 
is exhibited, it is a fair conclusion that no improvement is taking 
place! 
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2. Use of occasional check studies by general foremen on 
crews of individual foremen, followed by a significance test by 
use of the Control Charts. This is the more powerful device, 
but must be used with discretion. When the general foreman 
finds significantly different results than the foreman finds, the 
onus is usually on the foreman to prove his proportion is the 
true one. 

Actually, of course, this type of bias occurs almost solely 
through failure of the foreman to understand that no retri¬ 
bution will follow correct recording. In this case, a major con¬ 
tribution to improvement was made by continued demon¬ 
strations of good faith by engineers and management generally, 
so that the fear which prompted early bias in recording gradu¬ 
ally lessened, and results became independently repeatable. 

As a result of about six months of these studies, along with 
test applications of devices for measurement of work itself, a 
major program was instituted in 1955, for achievement of 
better planning and control of maintenance and construction 
work. This program hinged about several key steps: 

1. Continuation of Work Sampling on a periodic basis, for 
reliable measurement of improvement. A full-time inde¬ 
pendent observer was added to the engineering staff, to make 
spot studies and equipment studies, and to intensify the sam¬ 
pling where it became desirable. 

2. Creation of the job of methods planner. This group 
was charged with preplanning of major maintenance and 
construction work. The necessary communication and 
follow-up to make these plans effective were also designed and 
installed. 

3. Provision of accurate and meaningful budgetary cost and 
man-hour reports, using standards arrived at by successive 
approximations as knowledge and methods improved. 

4. Provision of automatic data feedback for continuing 
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improvement in planning of work. This phase is well under 
way, and of course promises greatest long term gain. 

Obviously, this entire program required use of a system for 
handling large masses of information economically. The 
company’s punched-card facilities were used wherever pos¬ 
sible, and an IBM Type 650 computer is now being pro¬ 
grammed for the major data-handling peak which is fast 
approaching. 

There is no doubt that the great key in all this program has 
been the desire for improvement by all concerned and a highly 
gratifying willingness to work together. Certainly neither 
Work Sampling nor any other phase of this program could 
have succeeded without this human cooperation. But in this 
situation, the technique of Work Sampling provided the cata¬ 
lyst with which to achieve this trust and faith so vital for 
improvement. 
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Materials Handling 


The Problem 

In this case, a household appliance factory used Work 
Sampling to help measure materials-handling costs. The fac¬ 
tory, manufacturing hot-water heaters, was engaged in a con¬ 
tinuing program of cost reduction. Many of the proposals 
made under this program involved some change of materials- 
handling equipment and procedures. Up to the time of the 
Work Sampling study, many of the costs associated with mate¬ 
rials handling had been hard to identify and measure. Work 
Sampling proved to be an effective means of measurement in 

this situation. 

Briefly, sheet steel was handled by fork truck through 
receiving, stores, various blanking and forming press opera¬ 
tions, and then onto a conveyor system for glass coating, weld¬ 
ing, and assembly. Finished, crated heaters also were 
handled by fork truck. Approximately twelve hundred 
heaters were manufactured each day. The plant was union¬ 
ized, and all direct-labor operations were covered by stop¬ 
watch time studies. The methods and standards department 
consisted of a chief industrial engineer and 11 men. 

From time to time various proposals had been submitted to 
extend the conveyor system back to include the initial press 
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operations. It seemed that these proposals had never been 
fully supported by facts, however, because information was 
lacking concerning the following: 

1. The amount of in-process handling required by the 
present system of fork truck moves through press operations 

2. The operating effectiveness of the fork trucks themselves 

“In-process” handling refers to the handling of materials 

within a workplace, as distinct from the actual performance 
of work on the product. Most production operations require 
a certain amount of this, as the work is transferred from tem¬ 
porary storage to the machine, and again as the work is placed 
m temporary storage after the operation. Sometimes these 
considerable amounts of time are overlooked as costs of a 
materials-handling system. One of the advantages of con¬ 
veyor systems is that if properly installed, some of this in- 
process handling may be reduced. 

Why Work Sampling Was Used 

It is possible to extract in-process handling time from the 
time standards which exist on the job. Even so, there are 
other handling times which take the form of percentage allow¬ 
ances which should be determined objectively. Finally, not 
all the indirect labor was covered by standards, and some of 
this activity was materials handling. It was thought that 
Work Sampling would give a direct measure of the time spent 
in m-process handling, and in addition would help in the 
determination of certain time-study allowances. 

In addition to the in-process handling done by operators, a 
study was made of the activity of the six fork trucks assigned 
to the area in which the initial press operations were per¬ 
formed. The objective here was not only to provide esti¬ 
mates of possible savings in the event of changes reducing 
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demands for fork-truck moving but also to appraise the 
effectiveness of fork-truck operation as it then existed. 


Organization for Work Sampling 

Time-study engineers regularly assigned to the area con¬ 
ducted the study. In addition, the union shop steward and 
the foreman were trained in the technique of Work Sampling, 
so that they would be able to make their own check studies. 
Training was done by a college professor, through an extension 
center arrangement. Five two-hour sessions were held, plus 
another two-hour session for a group of supervisors and union 
officers. In addition, one morning was spent in making trial 

rounds of observations in the shop. 

Twelve rounds of observations were made per nine and one- 
half working hour shift. Times of observation were selected 
from a table of random numbers. Numbers from 000 to 569 
were taken as they occurred in the table. The study extended 
over 4 weeks; 6 fork trucks and from 23 to 28 men were studie . 
Total number of observations for the trucks was 1,427, and for 
the operators, 6,173. The truck study will be discussed first. 


Selection of Categories and Results 


Categories of activity, with percentages of observations in 


each category, were as follows: 

Category 

1. Move with load. 

2. Move, no load. 

3. Adjust stacked material.*.* '' ‘ 

4. Move with die (a die is a large, heavy steel press tool) 

5. Assist in install or remove die. 

6. Not in use, no work available. 

7. Not in use, operator absent.. 

8. Not in use, maintenance, adjustment, or inspection 

9. Truck not in area being studied. 


% 

13.4 

15.7 

3.1 

0.4 

0.9 

46.1 

9.4 

6.3 

4.7 

100.0 


did not tell the entire story. Further 


These percentages 
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study of results showed that while a minor time cycle existed, 
in only 0.2 per cent of the rounds of observation were all 
trucks in use. In only 1.3 per cent of the rounds were as many 
as four trucks in use at the same time. It seemed obvious that 
there was not enough work to keep six trucks busy. 

The category Operator Absent was recorded 9.4 per cent of 
the time. This amounted to an average of 53 minutes a day. 
Personal time allowed operators was 5 per cent, or less than 
30 minutes a day. Actually, the operators realized what man¬ 
agement did not, namely, that too many trucks were assigned 
to the job. Also, maintenance, inspection, and recharging 
were supposed to be done at night. Only emergency repairs 
and adjustments should have been made during the periods 
studied. Yet the trucks were idled for maintenance 6.3 per 
cent of the time. This was considered to be an unsatisfactory 
condition. 

Finally, the study showed that die moving (0.4 per cent) and 
die handling (0.9 per cent) required a total of only 1.3 per cent 
of the time. The significance of this was that die handling as 
such was classified in the job evaluation plan as requiring 
exceptional’ 5 skill. This led to the payment of premium to 
all drivers who handled dies. The study showed that all this 
work could easily be handled by one truck. Assignment was 
made accordingly; in addition, crew assignments were speci¬ 
fied more closely among the machinists who installed the dies. 
Specific actions taken as a result of the truck study were: 

1. The number of trucks in use in this area was reduced 
from six to four. 

2. A new system of truck scheduling was instituted, to 
reduce travel and waiting time. 

3. An investigation was made of maintenance practices. 
This resulted in action which reduced maintenance time 
during the shift almost to zero. 
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4, Since management felt that the unsatisfactory conditions 
were primarily their own fault, no attempt was made to “crack 
down” on drivers. However, it was pointed out that no driver 
would be overworked as a result of the changes. 

5. As a result of the study, motion-picture techniques were 
used to develop standard times for planning moves. The 
Work Sampling was not used in this, but the conditions 
Work Sampling revealed were felt to warrant the further 
study. 

The Work Sampling study made of the operators in the area 
was quite similar to any other study of production workers in 
a standardized job situation. The only differences lay in the 
selection of categories in such a manner as to separate out the 
in-process materials handling. Although careful breakdown 
of existing methods descriptions should enable us to get this 
information, Work Sampling seemed a more positive approach. 
Also, management was in the process of attempting to build 
up basic measuring techniques for materials handling, and had 
decided to use Work Sampling as part of this program. 

Results of the Work Sampling study of direct-labor oper¬ 
ators in the area serviced by the trucks were as follows: 


Category 

1. Operating press, all elements... 

2. Press and tool adjustment. 

3. Materials handling, into press.. 

4. Materials handling, out of press 

5. Operator absent. 

6. Delay for material supply. 

7. Delay for material removal.... 

8. Delay, other. 


% 

27.1 

6.7 
20.6 
27.3 

5.8 
3.3 
5.2 
4.0 

100.0 


A few general remarks are in order concerning these results. 
First, press work involves a very rapid work cycle on the part 
of the machine, and thus the “work” part of the operators 
activity is bound to be low. Next, the operators had to stack 
finished work parts quite carefully. Not only were the parts 
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rounded and slippery, but also they were being stacked on 
pallets which then were moved by fork truck. F inall y all 
these jobs were being performed at a work pace averaging 
27 per cent above the time-study men’s concept of “normal,” 
as reflected in the standards covering these jobs. Thus the 
results were by no means indicative of an unsatisfactory per¬ 
formance under the presently specified method. 

A comparison was made between the actual Work Sam¬ 
pling results as they pertained to materials handling and the 
time allowed for materials handling in the various time stand¬ 
ards covering these jobs. It was discovered that observed 
materials-handling activity exceeded that “built in” to the 
standard by about 15 per cent. Obviously, this extra time 
must have come at the expense of some other element. In 
this case it was found that “operating press” and “tool and 
press” adjustment were less than expected. What had been 
occurring was that the operators had become a little sloppy 
in these elements because insufficient time had been allowed 
for the materials-handling elements. When the situation 
was corrected, incidentally, quality of product improved 
significantly. 

To pursue the materials-handling aspect, the press opera¬ 
tions were synthesized (using elemental human work times) 
for a method which would have conveyorized the operations. 

It is important to note that the Work Sampling showed how 
much time was now spent in materials handling. This pro¬ 
portion of time is the maximum which can be saved—and to 
save it, materials handling must be reduced to zero. Thus, 
by using conveyors, some of category 4 (Materials Handling, 
Out of Press) time could be saved, perhaps, but the 27.3 per 
cent observed in this category represents the absolute maxi¬ 
mum available for cost reduction purposes. From this must 
be subtracted the time to handle work out of the press in a 
new method. 
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To generalize for a moment, it has been the sad experience 
of some managements to have been put in the position of 
having installed materials-handling “systems” on the basis of 
glowing claims, only to find that expected savings did not 
materialize because the potential for large savings n*wr 
existed. In other words, a good cost analysis could not be 
made without the sort of over-all measure which Work Sam¬ 
pling can provide. This is not to deprecate the importance 
of materials handling. Rather it is to say that management 
realizes that it is costly to move and store material. The 
authors suggest that if factual information is available, this 
cost may be determined, and serve as the basis for better 
economic evaluation of proposed change. 

In this particular case, it was decided to handle material by 
fork truck to the first operation, and to handle by conveyors 
from that point on. Also, operating instructions were clari¬ 
fied to ensure more attention to oiling dies and to inspection 
procedures. The combination of Work Sampling and synthe¬ 
sized work times enabled management to justify the expense 
of the change. A Work Sampling study was made after two 
months’ operation. This study showed that the change was 
for the better, since all materials-handling expense was less 
than previous cost by an amount sufficient to more than pay 
for the change. 

To summarize, some costs of materials handling can be 
determined quite easily. Among these are fork-truck costs, 
costs for conveyor installations, space costs in warehouses, and 
so forth. Primarily, all such expense is due to handling and 
storage. It is more difficult to measure materials-handling 
expense when those handling the product also perform direct- 
labor operations on it. For this situation, Work Sampling has 
proved to be an effective tool of analysis. 
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Loom Utilization 


The Problem 

. A Carpet manufacturer was engaged in a program to 
improve the plant’s production control. Several objectives 
of this program could be met by improving office and planning 
procedures. The ultimate improvements, however, in addi¬ 
tion to resulting in a better inventory situation, should also 
benefit shop operations. In order to have a complete 
appraisal of the progress of the entire program, some analysis 
of shop activity was necessary. It was decided to take a Work 
Sampling study, aimed particularly at measuring the time 
which could be saved by better production control. 

Since capital investment in looms was quite considerable 
any down time resulting from lack of yarn was expensive’ 
The replacement cycle for the yarn was from six to eight 
weeks. Furthermore, good production control was necessary 
m order to keep inventory low, and service at the level 
demanded by the trade. Therefore a loom standing idle for 1 
lack of yarn represented a matter of some concern to manage¬ 
ment. Over the year preceding the study, production control 
performance had been steadily worsening. This was not the 
fault of the mill, but the mill was being penalized through short 
runs, waits for yarn, and irregular weave schedules. Also 
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every time a beam or creel (these are devices for storing yarn 
at the loom—the yarn goes from these directly to the loom) 
had to be cut or changed, production was lost and the cost of 
direct labor was increased. Therefore, as the program of 
improvement proceeded in the office, the effectiveness of oper¬ 
ation of the mill should also improve. The Work Sampling 
study was undertaken to provide measurement of this improve¬ 
ment, and also to find how much improvement could be 

expected. 

In addition to measuring the effects of production control 
on the shop, management wanted to check certain allowances 
given, and to establish a bench mark for the particular level 
of operation. The line supervisors were told to keep a careful 
record of unusual occurrences, to help establish this level. 

The mill was not unionized. One of the reasons for pro¬ 
duction control improvement was to permit better scheduling 
of personnel. Also, since the market was seasonal, it was pos¬ 
sible that a different policy might be necessary at different 
times of the year, that is, that shorter runs of different types of 
carpet would be made at slack times. It was hoped that the 
study would give information which would aid management 
in formulating this policy. 

Why Work Sampling Was Used 

Work Sampling seemed an obvious tool to obtain the type of 
information desired. As a matter of fact, Tippett’s first work 
was done in a similar situation. Basically, information was 
desired concerning a condition which definitely was not 
scheduled, namely, running out of raw material. Further¬ 
more, it was desired to observe the looms, and not the person¬ 
nel. While some data on the personnel would of course 
be collected-since people run looms-loom utilization was 
what management was after. The system of timekeeping m 
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effect made it quite difficult to obtain the needed information 
simply by examining time cards of the weavers. 

To generalize, what was wanted was an over-all measure¬ 
ment of what was very definitely an undesirable nonstandard 
shop condition. To look ahead, management planned a pro¬ 
gram which it was hoped would result in change for the better. 
Therefore whatever measurement technique was chosen should 
also have the characteristic that future comparisons could be 
made easily and consistently. In such situations, Work Sam¬ 
pling has proved to be quite effective. 

Organization for Work Sampling 

The industrial engineering department of the plant con¬ 
ducted the study. The chief industrial engineer served as 
director. The consultants who were working with production 
control supplied a small amount of training, but not much was 
necessary. A time-study man was assigned to take the 
observations. The industrial engineering department was 
staffed by six methods and time-study men, who were experi¬ 
enced in the shop and were very capable. Two of these men 
had had previous experience in Work Sampling, as had the 
chief industrial engineer. 

No other special comment is needed concerning the organ- 
ization. The Work Sampling study was simply another 
assignment for the industrial engineering department. It was 
within the scope of their ordinary duties, and the results wer§ 
sent to management in the same manner as other performance 
reports issued by the department. 

Selection of Categories 

In selecting the categories, the main objective was to sepa¬ 
rate out those delays which could be inferred to be a result 
of production control performance. In addition, the working 
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categories were selected in such a manner that they could be 
checked against existing incentive rates. The categories use 
terminology of the weave shed, but require little further 
explanation. A “runout” means that the creel or beam is 
empty and that a new one must be tied in to the loom. A “cut¬ 
out” means that there is still yarn on the beam or creel, but that 
a change of color is wanted badly enough to warrant the 
expense of tying a new beam or creel in to the loom. Runouts 
occur normally; cutouts reflect poor production control and 
are extremely expensive. The categories selected were as 

follows: 

1. Running time 

2. Hand time in weave rate 

3. Beam change—runout 

4. Beam change—cutout 

5. Weaver absent 

6. Change creel—runout 

7. Change creel—cutout 

S. No pile yarn or pile beam 

9. No binder or staffer beam 

10. No orders or not scheduled (loom idle) 

11. No manpower 

12. Machine repair—major 

13. Wait for decision (production control) 

14. Samples—production looms only 

15. Loom repair—done by fixer (mechanic) 

16. All others 

17. Change over loom (to different pattern) 

Collection of Observations 

An observation sheet of a very simple design was used (Fig. 
15-1) From the observations made on this sheet, a series of 
tabulating cards were punched. This punching was quite 
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simple, and made statistical analysis of the results a much more 
rapid procedure. Five rounds of observations were made 
each day, on the day shift only. It was decided that two 
weeks 5 observation would be sufficient. By that time almost 
seven thousand observations would have been obtained, which 
would give a level of reliability sufficient for the study’s objec¬ 
tive. The plant was working five and a half days per week. 



Fig. 15-1. Loom-utilization-study observation sheet. 


There were no special precautions necessary in collecting the 
data. The observers were experienced men, who had done 
Work Sampling before. The employees were informed of the 
study’s objectives, and of the fact that it would be taken. 

Results 

The results of the study are shown in Table 15-L Category 
10, No Orders or Not Scheduled (Loom Idle), was designated 
category B, and carried separately in the summation of results. 
This was done in order to verify certain allowances which were 
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given as a percentage of scheduled loom operation. Also, by 
presenting results in this fashion, it was felt that available loom 
time could be obtained directly. 

The results were broken down by loom width, which was the 
scheduling breakdown most convenient in interpreting per¬ 
formance. Also, type of loom was considered. The signifi¬ 
cant values were as follows: 

1. Category 8, No Pile Yarn or Pile Beam, represented a 
failure of production control to have the proper raw material 
on hand. This category represented the possible area for 
direct improvement through better production control. It 
should have been almost zero. 

2. Creel Cutout, category 7, is very undesirable. Supple¬ 
mentary records kept during the study showed that this too was 
caused by poor scheduling. 

3. The 12/4 Velvet looms were working three shifts, and 
still could not meet customer demand. At the same time, 
category B (category 10 in original list), No Orders or Not 
Scheduled, was 13.9 per cent of the total. Since orders were 
available, it was obvious that scheduling was at fault. 

4. Change Over Loom (category 17) was quite satisfactory. 
This is worthy of note, since the foremen had estimated that 
this activity took as much as 10 per cent of the loom time. 
This reflected favorably on production control. The inference 
was that yarn control was inadequate, but parts of loom 
scheduling of pattern change were satisfactory. 

5. To take the 12/4 Velvet looms as an example, category 11 
(No Manpower) represented a significant loss. What had 
happened was that the foreman hesitated to call in weavers 
because there might not be yarn for the loom, and thus 
wages would be lost. 

6. For the most critical looms, possible areas for savings 
through better production control were considerable. Lump- 
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Table 16-1. Summary op Results of Work Sampling Study 
op Loom Activity Conducted by Industrial 
__Engineering Department 


Element 

% Occurrence 

12/4 

Velvet 

16/4— 

20/4 

Velvet 

3/4, 
4/4, S/4 
Wilton 

12/4 

Wilton 

1 16/4, 
20/4 
Wilton 

1. Running time. 

61.3 

52.2 

32.3 

54.1 

52.3 

2. Hand time in weave rate. , . 

10.6 

15.0 

8.9 

11.1 

14 3 

3. Beam change—runout. . 

7.6 

9.6 

2.3 

2.2 

4 5 

4. Beam change—cutout.... 

0.2 


0 1 


n 9 

5. Weaver absent. 

3.9 

4.9 

6.9 

4.8 

U .4 

2 1 

6. Change creel—runout. 



0 7 

9 A 

9 Q 

7. Change creel—cutout. 



2.0 

6.6 

4 . O 

2 9 

8. No pile yarn or pile beam. . 

4.8 

6.1 

15.3 

6.8 

10.0 

9. No binder or stuffer beam. . 

0.3 

0.7 

0.4 



11. No manpower. 

5.7 

2.2 

0.5 


0 2 

12. Machine repair—major. 

0,9 

1.9 

1.8 

2.2 

1 0 

13. Wait for decision. 

0.4 


5.0 



14. Samples—production looms 




onlY. 

0.2 


19 A 



15. Loom repair—fixer. 

0.8 

2.6 

1 4 . D 

3.2 

3.5 

3.5 

16. All others. 

3.3 

3.5 

4.9 

5.5 

4.9 

17. Change over loom. 


1.3 

3.1 

0.6 

1.3 


100.0 

100.0 

100.0 

100.0 

100.0 

A. No observations—orders 






available. 

2,458 

974 

812 

316 

1,217 

B. No observations—no orders 






or not scheduled. 

342 

1 

488 

184 

58 

C. No orders or not scheduled, 






% of A. 

13.9 



KQ 9 

A O 

Total number of observations 

2,800 

975 

UU . 1 

1,300 

Oo. ju 

500 

4.8 

1,275 


ing together categories 4, 8, 9, 11, and 13, for the 12/4 looms, a 
total of 11.4 per cent is reached. This represents the worst 
situation, but of course this total is significant for all looms. In 
fairness, it must be added that only the velvet looms were 
really critically overloaded with customer orders. 

7. In general, the time standards proved out. Results of 
the study agreed closely with most of the running time and 
service categories in the study. 
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The real worth of this study was not only that it measured 
the current operation, but also that as changes in procedure 
were instituted in the production control office, the effect of 
these changes on shop operation could be measured. It was 
planned to take check studies at intervals of every three 
months. In general, management could then use the Con¬ 
trol Chart principles to measure change. Too often only sub¬ 
jective evaluation of over-all activity is available. 
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Case Study F: 

Punched-card Accounting Department 

The Problem 

A punched-card accounting department used 18 machines of 
various types. The machines had been in use for 20 years. 
Present performance was not entirely satisfactory, but was 
adequate. A program was being instituted leading to the 
installation of an electronic computer. As part of this, a 
Work Sampling study was planned for the punched-card 
accounting (tabulating) department. This program had two 
objectives: 

1. To determine the utilization of the various machines 

2. To determine the nature and extent of work-load cycles 
It should be added that past experience in the installation of 

high-speed computers has indicated the following: 

1. That in most cases present tabulating accuracy mu s t be 
improved 

2. That the total work load may be increased because of 
new demands for information 

3. That the work load probably will be distributed differ¬ 
ently among the present machines 

Fortunately, many of the changes mentioned above may be 
anticipated. Planning for the new computer installation is 
bound to be improved if present work loads are known. It 
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was for this purpose that the Work Sampling study was made. 
Only the equipment was studied at the outset. It was felt 
that this would meet the immediate need, and that a study of 
personnel might be made later, if necessary. 

The director of the study was the assistant office manager. 
He was a very capable man who had been trained in Work 
Sampling by a consultant. He had attended a business col¬ 
lege, and had little previous experience in statistics. The 
supervisor and his assistant acted as observers. The consult¬ 
ant assisted in training the observers. This training consisted 
of a day spent in discussion and development of categories of 
activity. In addition, the first two days’ sampling was used 
as a basis for further training, and the results were not included 
in the study. 

Eight observations per machine per day were made. It 
required about a minute for each round of observations. The 
observation sheet is shown in Fig. 16-1. The study extended 
over a five-week period in order to include monthly cyclic 
activity. In this study, the objective was to obtain an over-all 
picture. It should be realized that in other situations, much 
more information might be gathered in a similar study. 

Results of the study may best be expressed by including the 
report which was prepared for the committee responsible for 
installation of the computer. While at first glance it might 
appear that much detail has been omitted from this report, it 
should be remembered that the essential objectives were met. 
An advantage of Work Sampling is that it can be tailor-made 
to fit a given situation. There is no rigid pattern which must 
be followed in all studies, regardless of the real requirements. 
In this particular case, no immediate need could have been 
met by a much more detailed study, and the additional 
expense could not be justified. Also, the personnel involved 
were not experienced, and it was felt that success on a limited 
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Date. 


Observer 


Activity Key 

L Operating and running 5. Available 

2. Operating - not running 6. Not available (mainteo^ice) 

3. Summarizing 7. Trainee 

4. Not running-set up 


Machine Observed 



Time Observations Be<?an 



8 :i? 

9:SZ 

10 

IV.aC 

1:®? 

2 :f* 

3: of 

4: bo 

Key Punch No. 1 

t 

% 

> 


/ 

/ 


f 

Key punch No. 2 

/ 

t 

/ 

z- 

/ 

/ 

% 

/ 

Key punch No. 3 

/ 

> 

/ 


> 

/ 

/ 

/ 

Key punch No. 4 


S 

S 

vS' 

s 

S 

S 

S 

Key punch No. 5 

S 

s 

s 

s 

S' 

Jr 

jr 

s 

Key punch No. 6 

s 

s 

/ 

t 

/ 

/ 

/ 

/ 

Payroll tabulator 

3 

3 

s 

S' 

s 

S 

sr 

% 

Payroll sorter 

/ 

/ . 

t 

u 

f 

s 

S' 

/ 

Printing multiplier 

S' 

S' 

s 

S' 

s 

s 

s 

> 

Mechanical sorter 

l 

6 

\ _ 

c 

c 

c 

/ 

/ 

s 



V-— 


/ 

Sr-J* 

/ 

\^ 

s 

/ 

s 

L- 


Fig. 16-1. Machine-time sampling sheet—tabulating department. 


scale was of more value than an exhaustive study which would 
have involved more training and greater demands upon the 
time of busy people. 

REPORT OF WORK SAMPLING STUDY IN THE 
TABULATING DEPARTMENT 

I. Objectives: Overall— 

To determine the machine utilization pattern in the Tab Depart¬ 
ment. The study will not be concerned with the activity of person¬ 
nel, but rather with the activity of machines. 

Objectives: Detailed— 

(1) To obtain overall utilization, by machines and groups of 
machines. 
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(2) To establish in quantitative terms the nature of whatever 
cyclic trends exist in the Tab. Dept. 

(3) To enable planning to be done to schedule the work required 
in complete programming of payroll, cost, etc. to the Univac. 

Procedure: 

The supervisor and his assistant took the observations. Eight 
observations were made each day. All equipment was covered, 
including the bookkeeping machines. Randomization of times 
of observation was done within the hour. Categories were: 

1. Operating & Running 

2. Operating—Not Running 

3. Summarizing 

4. Not running, but set up to run 

5. Available (no job to put on machine) 

6. Maintenance (not available) 

7. Trainee 

No attempt was made to identify activity with any particular 
task (such as “running sales report”). 

Results: 

(1) The large chart labeled “Work Sampling Time Distribution 
in Tabulating Department” gives overall proportion of each activity, 
as a total and by machine groups. [This is Fig. 9-1 in this book.] 

The overall proportions of time spent in the individual categories 
are not as meaningful in this study as in some others, because 
“available” time, for example, may be high overall, and yet some 
machines may have an overload. Therefore, the results are best 
presented in tabular form, as follows: 




Category (as given previously) 



No. 1 

No. 2 

3 

o 

CO 

No. 4 

No. 5 

No. 6 

No. 7 

Total, all machines. 

33.5 

14.3 

1.8 

1.5 

45.0 

2.1 

1.8 

Key punch (6 machines). . 

47.7 

19.5 

0 

1.5 

25.4 

.5 

5.4 

Tabulators (3 machines). . 

23.9 

13.2 

11.0 

4.4 

46.0 

1.5 

0 

Sorters (3 machines). 

37.8 

20.8 

0 

1.0 

30.9 

9.5 

0 

Multiplier, interpreter, 
verifier, interfiler (1 each) 

20.5 

3.9 

0 

.1 

75.2 

.3 

0 

Bookkeeping machines (3). 

24.4 

11.8 

0 

.9 

62.6 

.3 

0 
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The cyclic effect of workload was shown by plotting categories 
by machine groups along a time axis. The supervisors expressed 
the opinion that these graphs agreed with their own impressions, 
and m addition gave a numerical value to the fluctuations. 

In general, although certain cycles exist, there was no case in 
which a group of machines were operating at capacity. This is 
not necessarily an undesirable condition, since most jobs require 
the use of more than one type of machine, and flexibility is important. 
But it does indicate that the present equipment can do additional 
jobs, if the jobs are scheduled to fit the now recognized cycles. 

Specifically, now that machine utilization is known, it will be 
possible to plan and schedule new procedures involving the com 
puter in the light of present “available" time. Not until the pres( nt 
equipment is much more fully utilized should it be necessary to 
consider new equipment. 

The supervisors are to be congratulated for their attention to 
the details of the work sampling. After the first two or three jobs 
have been put on the computer, they plan to take another work 
sampling study to determine the effect of the new procedures on the 
utilization of machines. 
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Case Study G: 

Joint Union-Management Study to 
Determine Machine-shop Allowances 


The Problem 

A 350-man plant manufactured bearings for the automotive 
industry. Production workers were on incentive pay. 
Standards had been set by stop-watch time study. Certain 
allowances which were “built in” to the standards had been 
questioned by the union. These allowances had been set 
while the studies were being taken. Also, several eight-hour 
production studies had been made to check allowances. At 
the time of contract renewal, the union held that the allow¬ 
ances were inadequate. Union representatives stated that the 
allowances for tool attention, materials handling, and inspec¬ 
tion had been set under substantially different conditions than 
now existed. This question of allowances was the only 
remaining hindrance to the renewal of the existing contract. 

Background of the Problem 

Union-management relations in this plant were on the 
whole good. The basic reason for the dispute was that the 
allowances had become almost traditional. However, re¬ 
quirements of quality of product had been tightened, and 
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batches of work had to be more carefully segregated. Tool 
nd die attention had become of greater importance. Finally 
because of an increasing number of new products, the time- 

lf U t h mC n had bCen UnaWe t0 giW en ° Ugh attention to some 
of the allowances. Both sides agreed that repetitive and 

machine-controlled elements of the standards were satisfac¬ 
tory. Rather than submit the problem to arbitration the 
union and management decided to conduct a joint Work Sam- 
p mg study. If the results of the study were acceptable, they 

would be used as a basis for settling allowances in the 
standards. 

The company was organized in a conventional line and staff 
type organization. The methods and time-study department 

of^ne t t0 ^° duCti ° n mana S er ‘ This group consisted 
ne time-study men who set rates, two college-trained 
industrial engineers who worked on methods, and a head of 
department, who had little formal education. The head of 
department was an excellent “shop man,” who was widely 
respected in the plant. y 

The union was a local of a large international union The 
union was organized traditionally, with union officers and shop 

hT ! u addhi ° n> therC WCre four time-study stewards, 
w o had been trained m summer schools conducted by the 
union and a state university. 

The staff of the international union had been participating 
in the renewal negotiations. It was suggested that a college 
professor be employed as technical advisor. This was agreed 
to by both sides. It was further decided that each side would 
take its own study, and that conditions of observation would be 
standardized so that the two studies should agree. Neither 
side would be bound in advance by the study in the event of 
significant differences in results. A 2<r limit was agreed upon 
as constituting significance. 
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Why Work Sampling Was Used 

Work Sampling was used in this case for the following rea- 

S °T. There would be no use of a stop watch or of rating or 
leveling techniques requiring exercise of judgment 

2. The results could be objectively tested for reliabi lty. 

3. The study would be relatively inexpensive. 

4 The allowances in question could be measured irect y. 
Basically, the union was not committing itself to the presen 
method of setting rates. Nor was management submitting as 
an issue the machine-paced and repetitive parts of the extstmg 
standards. The use of Work Sampling avoided many of the 
“matters of principle” over which rate disputes arise. 

Organization for Work Sampling 

Two plant time-study men and two union time-study stew¬ 
ards were designated to make the observations. They all were 
familiar with Work Sampling, although none had had expen 
ence in it. The college instructor trained all observers ^ 
actions a« which , union Caff man and the head =t the 
methods and time-study department were present Severa 
rounds of practice observations were made, and four three 
hour sessions comprised the formal training. It was agreed 
that all matters of procedure would be handled m similar 
sessions as the study was made. 

Selection of Categories 

Because of the nature of the study, categories were selected in 
such a way that all irregularly occurring work for which 
allowances were given would be classified into separate cate¬ 
gories. This led to quite a large number of categories. 

These were: 

01 Operating machine (hand paced) 
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10 Operating machine, machine paced, operator idle 

11 Operating machine, machine paced, operator gaging 

12 Operating machine, machine paced, operator cleaning 

parts 

13 Operating machine, machine paced, operator getting 

stock 

14 Operating machine, machine paced, other than above 
20 Gaging parts 

30 Handling stock 

40 Delay, talk with supervisor 

41 Delay, set up machine 

42 Delay, cleanup 

43 Delay, talk with inspector 

50 Tool attention, at grinders 

51 Tool attention, at tool crib 

52 Tool attention, resetting tool at machine 
60 Personal 

70 Absent from floor (assumed personal) 

80 Idle, wait for material 

81 Idle, wait for instructions 

82 Idle, wait for maintenance 

83 Idle, wait for inspection 

84 Idle, no work available 
90 Other activity 

Collection of Observations 

It was decided to collect a total of six thousand observations 
in each study. Time-study men and union stewards collected 
data independently of each other. A table of random num¬ 
bers was used, different times being drawn for each group. 
Eight rounds of observations per day were made. Observers 
were excused from other duties. A group of operators was 
observed which was felt to be typical. From 75 to 80 men 
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comprised the group. The study extended over two weeks’ 
time. 

The collection of data proceeded without incident. All 
employees had been informed of the study. A careful record 
was kept of production and other information necessary to 
establish whether or not the two-week period was indeed 
typical of plant operations. No specific cost data were made 
available. It had been calculated that six thousand readings 
would be sufficient to give proper reliability to the study. 
Such calculations, incidentally, are discussed in this book. As 
a simple example, however, the case problem concerning air¬ 
line reservation activity may be referred to. Very simply, all 
that is done is to substitute expected p in the formula 
-fi)/N, and to use required confidence limits for 
ft ± 2o> Then solve for N. 


Results 

The results of the study follow. The categories are listed, 
followed by the per cent observations in each recorded by the 
union stewards, and by the time-study men. 

The first test which was applied to the result was to see if the 
differences between the two sets of values could have occurred 
by chance alone. In other words, were there any systematic 
errors of observation which would have resulted in two differ¬ 
ent “populations” of data? The largest difference occurred in 
category 10, Operating Machine, Machine Paced, Operator 
Idle. This category might be held suspect in any event, 
because it involved one union member’s evaluation of another 
as being idle. In any event, it was assumed that the true 
p was 0.145, or midway between the two values obtained. 
Solving the equation 


2^ - 2 J 


fr(l ~ Ft 

N 


I0A 45(0855) 9 

~ Z \ 6,000 
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01 

10 


Category 


Operating machine, hand paced. 

Operating machine, machine paced, operator 


idle. 


IX I Operating machine, machine paced, operator 

gagmg. 

12 I Operating machine, machine paced,'operator' 


20 

30 

40 

41 

42 

43 

50 

51 

52 
60 
70 
80 
81 
82 

83 

84 
90 


cleaning parts 

13 I Operating machine, machine paced, operator 

getting stock. 

14 I Operating machine, machine paced', other than 

10 13 .. 

Gaging parts. 

Handling stock. 

Delay, talk with supervisor. 

Delay, set up machine. 

Delay, cleanup. 

Delay, talk with inspector. 

Tool attention, at grinders. 

Tool attention, at tool crib_ 

Tool attention, resetting tool at'machine' ' 
Personal. 

Absent from floor (assumed personal) 

Idle, wait for material. 

Idle, wait for instructions. 

Idle, wait for maintenance. 

Idle, wait for inspection. ’**_'* . 

Idle, no work available. 

Other activity. 


% 


'tcwardj 

3 study M 

39.1 

38.8 

14.2 

14.7 

1.3 

1.1 

2.1 

2.5 

1.1 

0.9 

3.5 

3.4 

2.0 

2.3 

4.2 

4.2 

0.6 

0.8 

4.0 

3.8 

0.9 

1.1 

0.2 

0.2 

2.5 

2.3 

2.7 

3.1 

2.5 

2.7 

1.9 

1.6 

2.9 

3.1 

1.0 

0.8 

0.8 

0.7 

0.7 

0.9 

0.2 

0.2 

8.8 

9.2 

1.9 

1.6 

0.0 

100.0 


— LUC average oi the two proportions 
observed, or either one as “correct,” the difference between the 
two proportions could have occurred by chance. Actually 

by any accepted test, the results were not significantly 
dmerent from one another. 


The greatest difference, as a per cent of the observed propor¬ 
tion, came in category 40, Delay, Talk with Supervisor. The 
difference, 0.2 per cent of the observed 0.6 per cent (or 0.8 per 
cent) was large, percentagewise. However, common sense” 
tells us that the total time involved is quite small. This is a 
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happy characteristic of Work Sampling, that reliability of very 
small proportions of activity requires more observations, but 
the over-all value of these categories also is put in proper per¬ 
spective. Why worry about a difference of 0.2 per cent of the 
whole' 1 Rather let us worry about the larger proportions, w ere 
real gains can be made through improved management practice. 

Production records were checked, and the two weeks which 
had been studied seemed to be typical of over-all operation. 
No particularly unusual shop conditions had existed, and there 
seemed to be no reason to believe that the Work Sampling 
could not be used as the basis for discussion. Boththeumona 
management agreed that the objective of the study had beenmet 
As might be expected, management was shocked by die 
amount of nonproductive time. However, no one denied 
that the conditions existed. Further, the results were checked 
with the totals of the “actual hours” charged to the various 
time cards, and found to be in agreement. In doing this, 
incidentally, the value of the large number of categorics was 
demonstrated, because it was possible to include all operating 
time categories, as well as the specific categories then charge 
to “actual hours,” and to compare these with the time cards 
in detail. That this was possible reassured management a 
their timekeeping system was satisfactory. 

The union felt that the results of the study supported their 
claim that present allowances were inadequate. For cxampe, 
Tool Attention, which was observed about 8 per cent o e 
time, presently was given an allowance of 3 per cent. Also, 
no allowance at all was given for the various Idle categories, 
the operators were supposed to punch out when no work was 
available, however. 

Further discussion of detailed results is not in order here 
Perhaps the most pertinent comment of all, however, was t 
of one member of the union bargaining committee, who sug- 
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gested that management should (1) thank the union for mak¬ 
ing such a study necessary and (2) hang their collective heads 
in shame for not doing Work Sampling themselves at an earlier 
time. As the union man said, management learned about 
their own operations “the hard way.” 

When bargaining was resumed, the question of allowances 
was disposed of very quickly. The allowance for tool atten¬ 
tion was increased from 3 to 8 per cent. Other allowances 
were allowed to remain the same. These were a 5 per cent 
personal allowance and a 2 per cent “miscellaneous” allow¬ 
ance. In the give-and-take of bargaining, the union agreed 
to hold off demands for the payment of average earnings when 
no work was available. Both sides went on record as recom¬ 
mending similar Work Sampling studies in the event of similar 
disputes in the future. 

Management instituted a thorough study of scheduling 
practice and of dispatching procedures. On the whole, they 
felt that there had been too little attention given to these areas. 
One very satisfactory aspect of the study made itself felt in the 
weeks following the study. Production increased more than 
enough to pay for the increased labor cost of the new contract. 
Management felt that this was due to the union's better under¬ 
standing of management’s problems and also to the better¬ 
ment in morale resulting from joint effort in getting facts from 
which to make decisions affecting the entire plant. This in 
itself was very profitable. 

In summary, neither side gave up any special “preroga¬ 
tive.” No one was committed in advance. And an objective 
measure of agreement was used. In collective bargaining, as 
in plant management, operating on the basis of fact seemed to 
pay off. Particularly in wage-incentive problems, however, 
the “facts” are sometimes hard to come by. This was one case 
where Work Sampling provided them. 
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Case Study H: 

Work Sampling of Indirect-labor 
Work Situations 


Work Sampling offers much promise as a measurement tech¬ 
nique in the study of indirect-labor cost. In many cases, it is 
the only technique which will enable management to deter¬ 
mine such cost in other than the grossest terms. This chapter 
will describe the use of Work Sampling in several work situa¬ 
tions involving indirect-type jobs. 

There are two general factors which have led to the placing 
of more importance on service or indirect-labor costs. These 
are: 

1. The trend toward automation in office and factory has 
led to a reduction in machine operators and an increase in such 
jobs as maintenance work and inspection activity. 

2. A desire on the part of management to obtain some sort of 
control over clerical and service costs per se. Traditionally, 
much of this work has not been measured because of its irregu¬ 
lar nature. 

The following examples have several common character¬ 
istics, namely: 

The work had not previously been measured. 

No detailed methods descriptions were available. 

The work involved dealing with customers or patients. 
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There was no intent to set time standards for incentive pay. 

The work situations to be discussed are typical of those 
where a general appraisal is desired, but where professional or 
customer-oriented personnel are being measured. This class 
of person usually has a lively interest in his job, and because of 
the irregular nature of the work, probably never has been 
exposed to measurement. Also, the objective of the study 
usually is to find means to allow such persons to spend their 
time most profitably in dealing with others, and to analyze all 
nonprofessional or clerical work so that more of this activity 
can be done by less skilled employees. 

Hospital Nursing and Patient Care 

A large-sized hospital (500 beds) was faced with a severe 
shortage of nurses, and with a rising cost of patient care. As a 
community service, a management society offered the services 
of its members to help solve these problems. The hospital 
management felt that a thorough study of nursing activity 
should be the first objective. The assistant director of nurses 
acted as the director of this study. 

A Work Sampling study was suggested as a means of analyz¬ 
ing the activity of nurses and other personnel engaged in 
patient care. It was felt that such a study would “put a 
number” on the various activities of patient care. Also, such 
a study would serve as a means of publicizing the fact that the' 
hospital management was in the process of working toward a 
solution of some of the nurses’ problems. This aspect of the 
study was emphasized by asking the nurses to participate as 
observers for the Work Sampling. 

Specifically, the objective of the study was to analyze the 
activity of all nursing personnel. From this analysis, pro¬ 
grams of corrective action were to be planned and executed. 
While this may seem like a limited objective, really it was quite 
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sound. Management simply wanted some factual informa- 
tion on which to act. Both the nurses and administrators 
recognized that a hit-or-miss study might do more harm than 
good. So an over-all appraisal was set as the objective. 

Each floor of the hospital was staffed by a floor nurse, who 
was in general charge, an assistant floor nurse, from one to 
three registered nurses, special-duty nurses, who were serving 
individual patients, from one to three student nurses, and one 
or two each of nurses’ aides and cleaning women. 

The floor nurses and their assistants acted as observers. 
Eight observations per eight-hour shift were taken. Two dif¬ 
ferent floors were studied, and both the 7 a.m. to 3 p.m. and 
3 p.m. to 11 p.m. shifts were covered. Times of observation 
were taken from a table of random numbers. The floors 
selected were felt to be typical of each of two methods of feed¬ 
ing, each of two main floor arrangements, and each of two 
types of patient service. It was decided to limit the initial 
study to two floors in order to ensure proper attention and 
training for a smaller study. The time of the members of the 
management society was limited, and it was felt that a small 
successful study would be of more value than complete cover¬ 
age without proper opportunity for supervision of the study. 
Training of observers and the defining of categories was done 
as a joint effort of the staff and the management society men. 

The categories decided upon were as follows: 

1. Accompany doctor on rounds 

2. Work on patient charts 

3. Other paper work 

4. Medication 

5. Preparing food and checking diet slip 

6. Serving food 

7. Treatment of patients 

8. Personal care of patients other than treatment 
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9. Not on floor 

10. Telephoning 

11. Instruction of student nurses 

12. Supervision of personnel other than nurses 

13. Cleaning rooms and making beds 

14. Admitting or discharging patients 

15. Conversation 

16. Other activity 

17. Walking 

After three days’ observation, a general discussion of the 
study was held with the nurses and the director of the study. 
The nurses felt that the categories might be expanded so that 
the category Preparing Food and Checking Diet Slips would be 
separated into two categories. In this way, the time for each 
of these activities could be measured. The activities differed 
in that one is manual, and the other clerical. In addition, 
new methods of serving food were planned. This separation 
was made, and Checking Diet Slips was designated as category 

18. The nurses volunteered the information that taking 
observations was not burdensome. It was decided not to 
include the first three days’ observations in the regular study, 
not only because of the category change, but also because this 
time had been designated as training. 

The study was started in earnest, and a total of 5,973 
observations was obtained over a period of 5 weeks. Since 
hospital records were quite complete (almost too complete), no 
particular additional supporting data were needed. Number 
of admissions, type of patient, and a few other data were used 
to check back in the records to establish the fact that the period 
studied was typical. 

The number of nurses varied throughout the study because 
(1) at night not as many registered nurses and special-duty 
nurses were on the floor and (2) special-duty nurses are 
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assigned to one patient, and the need for this service varies 
from day to day. The results of the study will be summarized 
in this discussion, but other breakdowns were made for hospital 
management. For instance, night activity was compared to 
day activity, and week-end activity to weekday activity. 
Further, an analysis was made of the reasons for the nurses 
being absent from the floor. All this information was 
included in a formal presentation of the results of the study. 
This presentation was made to hospital management and nurs¬ 
ing supervision in a joint meeting. The results of the study 
were as follows: 

All Observations 


Category 

1 . Accompany doctor on rounds. 

2. Work on patient charts. 

3. Other paper work. 

4. Medication. 

5. Preparing food. 

6. Serving food. 

7. Treatment of patients. 

8. Personal care of patients other than treatment 

9. Not on floor. 

10. Telephoning. 

11. Instruction of student nurses. 

12. Supervision of personnel other than nurses. . 

13. Cleaning rooms and making beds. 

14. Admitting or discharging patients. 

15. Conversation. 

16. Other activity. 

17. Walking. 

18. Checking diet slips. 


% 

4.7 

3.1 
1.6 

2.1 

9.1 
6.0 

3.4 

14.7 
11.6 

1.9 

1.3 

0.8 

9.5 

2.2 
7.7 

12.6 

4.1 

3.6 
100.0 


Hospital management and the nurses felt that the following 
results in particular categories were of most significance: 

1. The time spent in activity associated with patient feeding 
totaled 18.6 per cent. This was considered excessive. Also, 
the floor which served food in bulk required significantly more 
time for this activity than did the floor which served food in 
trays from the kitchen. 
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2. The 1.3 per cent of the time spent in instruction of student 
nurses was felt to be inadequate. 

3. The procedure for obtaining drugs was felt to be unsatis¬ 
factory. Most of the time m the Not on Floor category was 
spent in going to the pharmacy to get drugs and medications. 

4. Most of the Other Activity category was simply personal 
time. No conclusion was drawn from this other than that the 
nurses were not being rushed in over-all activity. 

5. Paper-work activity did not seem to be excessive. 

6. The nurses spent more time than was desirable in making 
beds and cleaning rooms. 

Specific action was taken to remedy the undesirable condi¬ 
tions. The first program started was an analysis of all phases of 
feeding. The basic contribution of the study was to show that 
this took the largest part of the nurses’ time. Also, the study 
indicated that bulk feeding was more demanding on the nurses 
than the use of trays prepared in the kitchen. Conventional 
process charts were used for further study. 

Steps were taken to ensure that the student nurses were given 
more formal instruction. This activity had been allowed to 
“slip.” 

An investigation was started of the issue of drugs. A new 
method was planned by which the pharmacist would make 
regular rounds with a cart containing the more commonly used 
drugs. 

The hospital administration felt that the objectives of the 
study had been met. A bench mark had been established 
against which progress could be measured. Improvement 
programs could be directed at those activities which had been 
shown to require excessive amounts of the nurses’ time. 
Finally, this had been done with the assistance of the nurses, 
and everyone had participated in the program. The mem¬ 
bers of the assisting management society were also in a better 
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position to help, because factual information now was avail¬ 
able. These results had been obtained at practically no cost, 
and without disturbing the professional relationship existing at 
the hospital. 

The outstanding accomplishment of such studies, in the 
opinion of most who have done them, is that Work Sampling 
enables the placing of a cost figure on nonstandardized activ¬ 
ity. The next step, of course, is to acquaint the professional 
personnel in charge of specifying the details of patient care 
with this cost. It then becomes a problem of determining 
whether or not the benefit derived from each activity is worth 
the cost. Finally, when this phase has been explored, a pro¬ 
posal to obtain the same result but by different methods usually 
is much better received. In other words, many hospital 
Work Sampling studies have resulted in a good statement of 
the problem, plus some indication of the most profitable 
areas for improvement. This in itself is a very worthwhile 
accomplishment. 

Airline Reservation Office—Telephone Activity of Agents 

This example is one that should be read with care. Not 
only does it demonstrate measurement in an indirect-labor 
situation, but also it is first-class evidence of the worth of the 
technique of Work Sampling. The write-up here will consist 
of a few explanatory remarks^ followed by an inclusion of the 
report submitted to management of the airline. 

Two explanatory remarks are necessary: 

1. One of the purposes of the report was to explain Work 
Sampling to others in the company. The industrial engineer¬ 
ing department was anxious to expand the use of Work Sam¬ 
pling. To do this, it was necessary to convince others that 
the technique is sufficiently precise. Therefore a comparison 
was made between Work Sampling results and the results of 
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continuous observation. Usually, we do not have the 
actual” to serve as a standard of comparison. 

2. The memo-motion camera mentioned is simply a mo¬ 
tion-picture camera which is controlled to take pictures at 
less than the usual speed of 16 frames per second. This tech¬ 
nique was originated by M. E. Mundel. * 

This study was conducted under the direction of A C Seccia 

of American Airlines. The authors regard it as a first-rate 
example of the use of Work Sampling. 


' T —ixvii JutxiyKjr 

DETERMINING THE AVERAGE LENGTH OF AN 
INCOMING TELEPHONE G ATT. 

The primary function of a group of agents in our Reservation’s 
offices is to answer incoming telephone calls from potential customers. 

e nature and length of these calls vary considerably. In order 
to accurately forecast the workload in our offices, it is necessary to 
know not only the expected number of incoming calls but, in addi- 

T’ 'T h ° f 3 CalL Combi “*g *ese two statistics, 

we can then adjust the manpower to handle the workload. 

n a recent study, for comparative purposes, the average length of a 
phone call was determined by two methods: 

I. Continuous Observation-using a memo-motion camera the 
monitor (observing board) board was photographed every 
second. By interpretation of the lamps lit on the board, at 

eac agent position, it was possible to determine whether an 
agent was: 

(a) Talking on an incoming call 

(b) Talking on an outgoing call 

(c) Available to accept an incoming call 

(d) Seated at his position but not ready or able to accept a call 
Through this continuous observation of agent activity the 
average length of a call was determined by hour of the day and 
for the entire period of study. 

II. nw. ih. of worl „ mp , illg 
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i.e. random observations, the average length of a call was deter 
mined for the same periods. 

The procedure followed was: 

1. An estimate of the percent of time agents spend handling 
incoming calls was made by substitution m the following. 


f V X H __ talking time 


where V = estimated average hourly incoming telephone vol- 
ume for the period to be studied 
H = estimated average length of an incoming phone 
call (in minutes) 

A = number of agents available for duty in the aver¬ 
age hour 

60 = number of minutes in an hour 

2. The sample size required was determined: 

(a) Using the percent estimated in Step 1, the total sample 
size required was determined. Since the average length 
of a call is an important statistic in determining t e 
workload, a small standard error was desired with a 
confidence level of 95%. 

(b) The total sample size was divided by the num er o 
agents on duty in the average hour to determine the num¬ 
ber of observation tours required. 

(c) The total number of observation tours was divided by the 
number of hours to be studied to determine the required 
number of observation tours per hour. 

The actual starting times of each observation tour was deter¬ 
mined from a table of random numbers. 

3. The observations were recorded on a form identical with that 
of Fig. 18-1. As the observer passed each agent position, he 
would record the activity of each agent at the precise moment 

Prior to starting the study, the various activities m which the 
agent could be engaged were determined to be: 

(a) Talking on an incoming call 

(b) Talking on an outgoing call 

(c) Waiting to accept an incoming call 
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(d) Available to accept an incoming call but finishing some 
clerical details of a previous call (this clerical work could 
be deferred if an incoming call should arrive) 

(e) Seated at his position but unable to accept an incoming 
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Fig. 18-1 


call (generally doing non-deferrable clerical work). 

4. The individual observations were summarized into hourly 
totals (Fig. 18-2) and the average length of call was com¬ 
puted for each hour and for the entire period of study. 

5. The standard error was determined. 
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Hourly Summary of Observations 


Average Length of an Incoming Call: DATE. 
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Comparison of Results 

The chart below, which compares the average length of call as deter¬ 
mined by Work Sampling with the average obtained by continuous 
observation, demonstrates the remarkable success we have had with 
the former tool. In spite of the fact that the sample size was based 
on the daily average per cent and there were wide variations in the 
hourly percentages, the hour by hour results of the two methods are 
comparable. 

In addition to the high degree of accuracy obtained for the average 
length of call, Work Sampling has enabled us to obtain needed 
additional information about agent activity. 



For example, when we make our observations at the monitor board, 
it is impossible to tell 'whether an agent is actually waiting for an 
incoming call or finishing up some clerical work when the light indi¬ 
cates his position available. This is an important statistic because 
we tram our agents to finish the clerical details (which would be of a 
deferrable nature) within the length of an incoming call. If the 
agents are not accomplishing this, a need for additional training is 
indicated. Analysis of the numbers or percentages in the other col¬ 
umns would reveal other needs or requirements. 

Many applications of Work Sampling have been tried and proven 
successful in our Reservations and Ticket Offices. Work Sampling 
ia one of our most frequendy used methods of collecting data. 

New York, N.V, 

March, 1956 
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AVERAGE LENGTH OF AN INCOMING CALL 

1. Estimated per cent of time (/>') agents talk on incoming call: 

V = 450 estimated average hourly phone volume. 

U = 4 minutes—estimated average call length. 

A = 40 expected number of agents on duty in the average hour. 


VXH _ 450 X 4 _ 1800 
A X 60 40 X 60 2400 


= 75% 


2. Sample size required: 

( a ) p f — estimated per cent = 75% = .75 

y = allowable margin of error = ±3% = ±-03 
oy = standard error = yp f = .03 X .75 = ±.0225 
To achieve a confidence level of95%oy/2 — .01125 

*• _ P'd - P') - - 75 C : g5) = _J875_ = , tal , 


= 1476 total sample size 

(.01125) 2 .000127 


(b) 1476 = total sample size required. 

40 = expected number of agents on duty in the average 
hour. 


-- =36.9 observation tours required 

40 

(c) 36.9 = observation tours required. 

9.0 = hours to be covered during study. 

36 9 

= 4.1 observation tours per hour 

Note: 4.1 rounded to 5 observation tours per hour 

3. Computation of Standard Error 
p - .745 
1 - f = .255 
N = 1880 

° r ~ \ N \ 1880 V 

a-p = .01 «= 1 % 

2<r 5 = .02 = 2% 
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p = .745 
P + 2<rj = .765 
P- 2o- ? = .725 

Therefore, limits are within the allowable margin of error, i.e. ± 3 %. 
Returning to the formula in paragraph 1 above and substituting the 
derived p and solving for H yields an average call length of 3.65 

minutes, with upper and lower 95% limits of 3.75 and 3.55 minutes 
respectively. > 
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Directions for Use of Tables A and B 

Tables A and B are designed for use with a desk calculator 
or a slide rule, in order to obtain quickly and accurately 
probability limits for any value of p, or j>, and for any given 
sample size from 31 to 5,000. Limits at either 95 or 99 per 
cent (approximately) may be derived from thes e tables. 

Table A contains values of the expressions 2 Vp( 1 - p) ^ and 
3 sjp(\ — p) for values of p or p from 0.01 to 0.99, that is, from 
1 % to 99 %. Table B contains the values of Vn for 240 differ¬ 
ent values of n from 31 to 5,000. Interpolation on a linear 
basis between any two consecutive values on either table will 
yield an approximately correct value for intermediate points 
not given in the tables. 

The following examples show in detail some of the ways in 
which these tables may be used to assist in establishing limits in 
Work Sampling: 

1. Given any p value, in per cent, to find 95 per cent confi- 
dence limits within which succeeding values of p, in per cent, 
should fall, assuming no change in the true value of p' during 
sampling, and assuming that random sampling conditions 

apply: 

Assume: p = 20 per cent, or 0.20 
n = 200 

The upper control limit for p is 


2 P) _ 0 20 q. 


0.8000 


UCLp = p + — - -^- n — = u '“ T 14714 

= 0.20 + 0.057 = 0.257 = 25.7 per cent 
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The lower control limit for p is 


LCLp = p 


2 V>(1 -p) 


■\/n 

= 0.20 - 0.057 « 0.143 


= 0.20 


0.8000 
14.14 

14 3 npr 


2 . Given any p value, in per cent, to find 95 per cent confi¬ 
dence limits within which succeeding values of the quantity 
np should fall, assuming no change in the true value of p f during 
sampling, and assuming that random sampling conditions 
apply. In other words, given a p value equal to 20 per cent, 
and a sample of 200, np is equal to 40; this is the discrete 
number of observations or samples which fall into this cate¬ 
gory. To find limits, expressed in discrete units, proceed as 
follows: 


VCL np * np + 2 y/p{\ - p) (Vk) = 40 + 0.8000(14.14) 
= 40 + 11.31 = 51.31 

LCL np = np - 2 VjKl “ P) (V«) “ 40 - 0.8000(14.14) 
= 40 - 11.31 =* 28.69 


Since in Work Sampling (and in most attribute sampling) 
we cannot have a fraction of an observation, 51 is the maxi¬ 
mum number of observations which we could expect to occur 
by chance alone, and 29 is the minimum, since 28.0 would be 
below the limit. 

3. Calculations similar to the above can be made, using 99 
P er cent confi dence limits, by merely substituting the value of 
3 Vp{\ — p) in each equation for 2 V/>( 1 — p). In Exam¬ 
ple 1, above, using 99 per cent limits, UCL^ would become 
0.285, or 28.5 per cent, while LCL^ would become 0.115, or 
11.5 per cent. Similarly, in Example 2, above, UCL np would 
be 56.97, or 56, and LCL n?) would equal 23.03, or 24. 

4. Given any value of j5, that is, the average of a number of 
successive values of p , to find the 99 per cent confidence limits 
within which all p values (used in computing p) should lie, 
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assuming no change in the true value of p r during sampling, 
and assuming random sampling conditions applied: 

Assume: p = 0.12 

20 successive samples, each having n — 140 


UO L, = f + lV»Lz£) = o, 2 + MZ“ 

= 0.12 + 0.082 = 0.202, or 20.2 per cent 


5. Under the same assumptions and conditions as in Exam¬ 
ple 4 , to find limits for np , that is, in discrete units: 

UCL np = np + 3 VKl ~ p) (V~n) = 16.80 + 0.9750(11.83) 

- 16.80 + 11.53 - 28.33, or 28 
LC L np = 16.80 - 11.53 = 5.27, or 6 


6 . To find the 95 per cent limits for Examples 4 and 5, sim¬ 
ply substitute the values of 2 Vp( 1 — p) for 3 Vj5( 1 — p), 
wherever applicable. 

7. Given the same data and assumptions as in Examples 4 
and 5, above, to find 99 per cent confidence limits for j), rather 
than for individual p values, that is, to determine the limits 
between which future values of p should fall, using a number of 
series of 20 samples of 140 each, so that n is equal to 2,800. 
This is the type of calculation which would be used, for exam¬ 
ple, to determine whether a significant change had or had not 
taken place in a certain p' during an interval in which no 
observations were made. 

In terms of p in per cent: 


UCLs = p 4- 


3 V?”(l - p) 


0.12 + 


0.9750 


Vi ‘ 52.92 

= 0.12 + 0.018 = 0.138, or 13.8 per cent 
LCLj = 0.12 — 0.018 = 0.102, or 10.2 per cent 
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In terms of rifi, or discrete units: 

UCL n £ = nf + 3 \/p(l - P) (Vn) = 336 + 0.9750(52.93) 

= 336 + 51.6 = 387.6, or 387 ; 

LCL n p = 336 - 51.6 = 284.4, or 285 

8 . Given the same data and assumptions as in Example 7, 
above, to find 95 per cent confidence limits, simply substitute 
2 Vj5(l — p) for 3 V/5(l — ft), wherever it appears. 

Directions for Use of Table C* 

Table C has been prepared to enable the user to predeter¬ 
mine the sample size necessary in order to achieve a given 
degree of precision in the estimate of a category proportion p. 
For example, it can be used to determine how large a total 
sample must be made in order to achieve an error no larger 
than ± 5 per cent around a single estimated /> value of, say, 
15 per cent. Also, this table can be used to determine the 
number of observations per sample which should be made to 
obtain a given error around a p value. Moreover, by inter¬ 
polation where necessary, it assists in approximating a preci¬ 
sion present in any p value obtained from a total sample falling 
between maximum and minimum values falling on the same 
line of Table G. The entire Table G is based upon the 95 per 
cent confidence limits. 

The following are specific examples of its use: 

1. Given, from preliminary observations, an approximate/? 
of 15 per cent, or 0.15, what total sample must be taken in 
order to obtain a reliability of 95 per cent that the true value/)' 
lies within 1 per cent of 15 per cent, i.e., from 14 to 16 per cent? 

By reference to Table G, for p — 0.15, for a 95 per cent confi¬ 
dence limit of 0.01, we find n = 5,100. This means that at 

* The authors are indebted to Prof. P. J. Thorsen, of Michigan State College, 
for the idea and some of the material contained in Table C. 
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Table B. Values of n and Vn 


n 

y/n 

n 

y/n 

n 

y/n 

n 

y/n 

n 

y/n 

n 

y/n 

31 

5.57 

71 

8.43 

155 

12.45 

355 

18.84 

610 

24.70 

1050 

32.40 

32 

5.66 

72 

8.49 

160 

12.65 

360 

18.97 

620 

24.90 

1100 

33.17 

33 

5.74 

73 

8.54 

165 

12.85 

365 

19.11 

630 

25.10 

1150 

33.91 

34 

5.83 

74 

8.60 

170 

13.04 

370 

19.24 

640 

25.30 

1200 

34.64 

35 

5.92 

75 

8.66 

175 

13.23 

375 

19.37 

650 

25.50 

1250 

35.36 

36 

6.00 

76 

8.72 

180 

13.42 

380 

19.49 

660 

25.69 

1300 

36.06 

37 

6.08 

77 

8.78 

185 

13.60 

385 

19.62 

670 

25.88 

1350 

36.74 

38 

6.16 

78 

8.83 

190 

13.78 

390 

19.75 

680 

26.08 

1400 

37.42 

39 

6.25 

79 

8.88 

195 

13.96 

395 

19.88 

690 

26.27 

1450 

38.08 

40 

6.32 

80 

8.94 

200 

14.14 

400 

20.00 

700 

26.46 

1500 

38.73 

41 

6.40 

81 

9.00 

205 

14.32 

405 

20.13 

710 

26.65 

1550 

39.37 

42 

6.48 

82 

9.06 

210 

14.49 

410 

20.25 

720 

26.83 

1600 

40.00 

43 

6.56 

83 

9.11 

215 

14.66 

415 

20.37 

730 

27.02 

1650 

40.62 

44 

6.63 

84 

9.17 

220 

14.83 

420 

20.49 

740 

27.20 

1700 

41.23 

45 

6.71 

85 

9.22 

225 

15.00 

425 

20.62 

750 

27.39 

1750 

41.83 

46 

6.78 

86 

9.27 

230 

15.17 

430 

20.74 

760 

27.57 

1800 

42.43 

47 

6.86 

87 

9.33 

235 

15.33 

435 

20.86 

770 

27.75 

1850 

43.01 

48 

6.93 

88 

9.38 

240 

15.49 

440 

20.98 

780 

27.93 

1900 

43.59 

49 

7.00 

89 

9.43 

245 

15.65 

445 

21.10 

790 

28.11 

1950 

44.16 

50 

7.07 

90 

9.49 

250 

15.81 

450 

21.21 

800 

28.28 

2000 

44.72 

51 

7.14 

91 

9.54 

255 

15.97 

455 

21.33 

810 

28.46 

2100 

45.83 

52 

7.21 

92 

9.59 

260 

16.12 

460 

21.45 

820 

28.64 

2200 

46.90 

53 

: 7.28 

93 

9.64 

265 

16.28 

465 

21.56 

830 

28.81 

2300 

47.96 

54 

7.35 

94 

9.70 

270 

16.43 

470 

21.68 

840 

28.98 

2400 

48.99 

55 

7.42 

95 

9.74 

275 

16.58 

475 

21.80 

850 

29.16 

2500 

50.00 

56 

7.48 

96 

9.80 

280 

16.73 

480 

21.91 

860 

29.33 

2600 

50.99 

57 

7.55 

97 

9.85 

285 

16.88 

485 

22.02 

870 

29.50 

2700 

51.96 

58 

7.62 

98 

9.90 

290 

17.03 

490 

22.14 

880 

29.67 

2800 

52.92 

59 

7.68 

99 

9.95 

295 

17.18 

495 

22.25 

890 

29.83 

2900 

53.85 

60 

7.75 

100 

10.00 

300 

17.32 

500 

22.36 

900 

30.00 

3000; 

54.77 

61 

7.81 

105 

10.25 

305 

17.46 

510 

22.58 

910 

30.17 

3200 ! 

56.57 

62 

7.87 

110 ! 

10.49 

310 

17.61 

520 

22.80 

920 

30.33 

3400: 

58.31 

63 

7.94 

115 

10.72 

315 

17.75 

530 

23.02 

930 

30.50 

3600 

60.00 

64 

8.00 

120 

10.95 

320 

17.89 

540 

23.24 

940 

30.66 

3800 

61.64 

65 

8.06 

125! 

11.18 

325 

18.03 

550 

23.45 

950 

30.82 

4000 

63.25 

66 

! 8.12 

130 

11.40 

330 

18.17 

560 

23.66 

960 

30.98 

4200 

64.81 

67 

! 8.19 

135 

11.62 

335 

18.30 

570 

23.88 

970 

31.15 

4400 

66.33 

68 

8.25 

140 

11.83 

340 

18.44 

580 

24.08 

980 

31.31 

4600 

67.82 

69 

8.31 

145 

12.04 

345 

18.57 

590 

24.29 

990 

31.46 

4800| 

69.28 

70 

8.37 

150 

12.25 

350 

18.71 

600 

24.49 

1000 

31.62 

5000; 

70.71 
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Table C. Sample Sizes Required for Various Limits of Error. 
95 Per Cent Confidence Limits 


Sample Size Required for Confidence Limits at 95 % 


p 

±0.01 

±0.02 

±0.03 

±0.04 

±0.05 

V 

0.01 

396* 

100* 

44* 

25* 

16* 

0.99 

0.02 

784 

196* 

88* 

49* 

32* 

0.98 

0.03 

1,163 

292 

130* 

73* 

47* 

0.97 

0.04 

1,535 

384 

171 

96* 

62* 

0.96 

0.05 

1,900 

475 

212 

119 

76* 

0.95 

0.06 

2,260 

565 

252 

142 

92* 

0.94 

0.07 

2,604 

654 

290 

163 

102 

0.93 

0.08 

2,945 

738 

328 

184 

118 

0.92 

0.09 

3,278 

820 

364 

205 

131 

0.91 

0.10 

3,600 

900 

400 

225 

144 

0.90 

0.11 

3,918 

980 

435 

245 

157 

0.89 

0.12 

4,224 

1,055 

470 

264 

169 

0.88 

0.13 

4,520 

1,130 

504 

282 

181 

0.87 

0.14 

4,820 

1,210 

535 

302 

193 

0.86 

0.15 

5,100 

1,275 

568 

318 

205 

0.85 

0.16 

5,380 

1,350 

600 

337 

216 

0.84 

0.17 

5,650 

1,415 

628 

353 

226 

0.83 

> 0.18 

5,900 

1,475 

656 

369 

236 

0.82 

0.19 

6,160 

1,545 

685 

385 

246 

0.81 

0.20 

6,410 

1,605 

715 

400 

256 

0.80 

0.21 

6,640 

1,660 

740 

415 

266 

0.79 

0.22 

6,870 

1,720 

765 

430 

275 

0.78 

0.23 

7,100 

1,780 

790 

444 

284 

0.77 

0.24 

7,300 

1,830 

815 

456 

292 

0.76 

0.25 

7,500 

1,880 

835 

470 

300 

0.75 

0.26 

7,690 

1,925 

855 

481 

308 

0.74 

0.27 

7,885 

1,970 

875 

493 

316 

0.73 

0.28 

8,065 

2,015 

895 

504 

323 

0.72 

0.29 

8,240 

2,060 

915 

515 

330 

0.71 

0.30 

8,400 

2,100 

935 

526 

337 

0.70 

0.31 

8,555 

2,140 

950 

535 

343 

0.69 

0.32 

8,705 

2,175 

965 

545 

349 

0.68 

0.33 

8,840 

2,210 

985 

553 

354 

0.67 

0.34 

8,975 

2,245 

1,000 

561 

360 

0.66 

0.35 

9,100 

2,275 

1,010 

569 

365 

0.65 

0.36 

9,220 

2,305 

1,025 

576 

369 

0.64 

0.37 

9,325 

2,330 

1,035 

583 

373 

0.63 

0.38 

9,425 

2,355 

1,045 

589 

377 

0.62 

0.39 

9,515 

2,380 

1,055 

595 

381 

0.61 

0.40 

9,600 

2,400 

1,065 

600 

384 

0.60 

0.41 

9,675 

2,420 

1,075 

605 

387 

0.59 

0.42 

9,745 

2,435 

1,085 

609 

390 

0.58 

0.43 

9,805 

2,450 

1,090 

613 

392 

0.57 

0.44 

9,855 

2,465 

1,095 

616 

395 

0.56 

0.45 

9,900 

2,475 

1,100 

619 

397 

0.55 

0.46 

9,935 

2,485 

1,105 

621 

398 

0.54 

0.47 

9,965 

2,490 

1,110 

623 

399 

0.53 

0.48 

9,985 

2,495 

1,110 

624 

400 

0.52 

0.49 

9,995 

2,500 

1,115 

625 

400 

0.51 

0.50 

10,000 

2,500 

1,115 

625 

400 

0.50 


* Since, as a rule of thumb, should equal 5 or more, the numbers followed by * should 
be increased to meet this criterion. For example, for p-0.03, n should be increased from 
130 to 167, so that 0.03(167) = 5. 

least 5,100 observations must be made to ensure a p f of 14 to 16 
per cent. Note here that if ±3 per cent is desired, i.e., from 
12 to 18 per cent, n = 568, or slightly more than one-tenth as 
large a sample! 
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2 . Given a sample size of 180 observations per day, what 
precision would a single category per cent derived from this 
sample have? Or, restated, what confidence limits, at 95 per 
cent, could be placed on a Control Chart drawn so that each 
day’s observations represented a single point on the Chart? 

The answer to this question depends upon the proportion p 
that is obtained in the sampling, using n = 180. For exam¬ 
ple, lip •■= 0.13, the 95 per cent confidence limits would be set 
at +0.05, that is, samples having p values from 8 to 18 per cent 
could be expected to occur by chance alone. Again, if 
p = 0.08, the confidence limits would be placed at ±0.04, or 
from 4 per cent as a lower limit to 12 per cent as an upper 
limit. 

3. Given a p of 0 . 22 , n = 850, what is the range within 
which p' lies, using the 95 per cent confidence limits? 

From Table C, for p = 0.22, we find that n = 850 lies be¬ 
tween + 0.02 and +0.03. By linear interpolation (which is 
not quite correct, but is usually sufficiently close for purposes 
of Work Sampling), 


0.02 + 


1,720 - 850 870 

1,720 - 765 (0 '° ’ “ °' 02 + occ (°- 01 ) 


955 

0.02 + 0.91(0.01) 


0.02 + 0.009 = 0.029 


Therefore, the limits are approximately 0.22 ± 0.029, or 
from 0.191 to 0.249, that is, from 19.1 to 24.9 per cent. 
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Areas under the Normal Curve 

Proportion of total area under the curve that is under the portion of the curve from -<*> to 
it'. (Xt represents any desired value of the variable X.) 


Xi - X' 
a* 

0.09 

0.08 

0.07 

0.06 

0.05 

0.04 

0.03 

0.02 

0.01 

0.00 

-3.5 

3.00017 

3.00017 

3.00018 

3.00019 

3.00019 

3.00020 

3.00021 

3.00022 

0.00022 

3.00023 

-3.4 

3.00024 

3.00025 

3.00026 

3.00027 

3.00028 

3.00029 

3.00030 

0.00031 

0.00033 

3.00034 

-3.3 

0.00035 

0.00036 

0.00038 

3.00039 

0.00040 

3.00042 

3.00043 

0.00045 

0.00047 

3.00048 

-3.2 

0.00050 

0.00052 

0.00054 

0.00056 

0.00058 

0.00060 

3.00062 

0.00064 

0.00066 

3.00069 

-3.1 

0.00071 

0.00074 

0.00076 

0.00079 

0.00082 

0.00085 

0.00087 

0.00090 

0.00094 

0.00097 

-3.0 

0.00100 

0.00104 

0.00107 

0.00111 

0.00114 

0.00118 

0.00122 

0.00126 

0.00131 

0.00135 

-2.9 

0.0014 

0.0014 

0.0015 

0.0015 

0.0016 

0.0016 

0.0017 

0.0017 

0.0018 

0.0019 

-2.8 

0.0019 

0.0020 

0.0021 

0.0021 

0.0022 

0.0023 

0.0023 

0.0024 

0.0025 

0.0026 

-2.7 

0.0026 

0.0027 

0.0028 

0.0029 

0.0030 

0.0031 

0.0032 

0.0033 

0.0034 

0.0035 

-2.6 

0.0036 

0.0037 

0.0038 

0.0039 

0.0040 

0.0041 

0.0043 

0.0044 

0.0045 

0.0047 

-2.5 

0.0048 

0.0049 

0.0051 

0.0052 

0.0054 

0.0055 

0.0057 

0.0059 

0.0060 

0.0062 

-2.4 

0.0064 

0.0066 

0.0068 

0.0069 

0.0071 

0.0073 

0.0075 

0.0078 

0.0080 

0.0082 

-2.3 

0.0084 

0.0087 

0.0089 

0.0091 

0.0094 

0.0096 

0.0099 

0.0102 

0.0104 

0.0107 

-2.2 

0.0110 

0.0113 

0.0116 

0.0119 

0.0122 

0.0125 

0.0129 

0.0132 

0.0136 

0.0139 

-2.1 

0.0143 

0.0146 1 

0.0150 

0.0154 

0.0158 

0.0162 

0.0166 

0.0170 

0.0174 

0.0179 

-2.0 

0.0183 

0.0188 

0.0192 

0.0197 

0.0202 

0.0207 

0.0212 

0.0217 

0.0222 

0.0228 

-1.9 

0.0233 

0.0239 

0.0244 

0.0250 

0.0256 

0.0262 

0.0268 

0.0274 

0.0281 

0.0287 

-1.8 

0.0294 

0.0301 

0.0307 

0.0314 

0.0322 

0.0329 

0.0336 

0.0344 

0.0351 

0.0359 

-1.7 

0.0367 

0.0375 

0.0384 

0.0392 

0.0401 

0.0409 

0.0418 

0.0427 

0.0436 

0.0446 

-1.6 

0.0455 

0.0465 

0.0475 

0.0485 

0.0495 

0.0505 

0.0516 

0.0526 

0.0537 

0.0548 

-1.5 

0.0559 

0.0571 

0.0582 

0.0594 

0.0606 

0.0618 

0.0630 

0.0643 

0.0655 

0.0668 

-1.4 

0.0681 

0.0694 

0.0708 

0.0721 

0.0735 

0.0749 

0.0764 

0.0778 

0.0793 

0.0808 

-1.3 

0.0823 

0.0838 

0.0853 

0.0869 

0.0885 

0.0901 

0.0918 

0.0934 

0.0951 

0.0968 

-1.2 

0.0985 

0.1003 

0.1020 

0.1038 

0.1057 

0.1075 

0.1093 

0.1112 

0.1131 

0.1151 

-1.1 

0.1170 

0.1190 

0.1210 

0.1230 

0.1251 

0.1271 

0.1292 

0.1314 

0.1335 

0.1357 

-1.0 

0.1379 

0.1401 

0.1423 

0.1446 

0.1469 

0.1492 

0.1515 

0.1539 

0.1562 

0.1587 

-0.9 

0.1611 

0.1635 

0.1660 

0.1685 

0.1711 

0.1736 

0.1762 

0.1788 

0.1814 

0.1841 

-0.8 

0.1867 

0.1894 

0.1922 

0.1949 

0.1977 

0.2005 

0.2033 

0.2061 

0.2090 

0.2119 

-0.7 

0.2148 

0.2177 

0.2207 

0.2236 

0.2266 

0.2297 

0.2327 

0.2358 

0.2389 

0.2420 

-0.6 

0.2451 

0.2483 

0.2514 

0.2546 

0.2578 

0.2611 

0.2643 

0.2676 

0.2709 

0.2743 
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Areas under the Normal Curve (i Continued ) 


Xi - X' 

0.09 

0.08 

0.07 

0.06 

0.05 

0.04 

0.03 

0.02 

0.01 

-y » . 

0.00 

<r' 

-0.5 

0.2776 

0.2810 

0.2843 

0.2877 

0.2912 

0.2946 

0.2981 

0.3015 

0.3050 

0.3085 

— 0.4 

0.3121 

0.3156 

0.3192 

0.3228 

0.3264 

0.3300 

0.3336 

0.3372 

0.3409 

0.3446 

-0.3 

0.3483 

0.3520 

0.3557 

0.3594 

0.3632 

0.3669 

0.3707 

0.3745 

0.3783 

0.3821 

-0.2 

0.3S59 

0.3897 

0.3936 

0.3974 

0.4013 

0.4052 

0.4090 

0.4129 

0.4168 

0.4207 

-0.1 

0.4247 

0.4286 

0.4325 

0.4364 

0.4404 

0.4443 

0.4483 

0.4522 

0.4562 

0.4602 

-0.0 

0.4641 

0.4681 

0.4721 

0.4761 

0.4801 

0.4840 

0.4880 

0.4920 

0.4960 

0.5000 

+0.0 

0.5000 

0.5040 

0.5080 

0.5120 

0.5160 

0.5199 

0.5239 

0.5279 

0.5319 

0.5359 

+ 0.1 

0.5398 

0.5438 

0.5478 

0.5517 

0.5557 

0.5596 

0.5636 

0.5675 

0.5714 

0.5753 

+0.2 

0.5793 

0.5832 

0.5871 

0.5910 

0.5948 

0.5987 

0.6026 

0.6064 

0.6103 

0.6141 

+0.3 

0.6179 

0.6217 

0.6255 

0.6293 

0.6331 

0.6368 

0.6406 

0.6443 

0.6480 

0.6517 

+0.4 

0.6554 

0.6591 

0.6628 

0.6664 

0.6700 

0.6736 

0.6772 

0.6808 

0.6844 

0.6879 

+U.5 

0.6915 

0.6950 

0.6985 

0.7019 

0.7054 

0.7088 

0.7123 

0.7157 

0.7190 

0.7224 

+0.6 

0.7257 

0.7291 

0.7324 

0.7357 

0.7389 

0.7422 

0.7454 

0.7486 

0.7517 

0.7549 

+0.7 

0.7580 

0.7611 

0.7642 

0.7673 

0.7704 

0.7734 

0.7764 

0.7794 

0.7823 

0.7852 

+0.8 

0.7881 

0.7910 

0.7939 

0.7967 

0.7995 

0.8023 

0.8051 

0.8079 

0.8106 

0.8133 

+0.9 

0.8159 

0.8186 

0.8212 

0.8238 

0.8264 

0.8289 

0.8315 

0.8340 

0.8365 

0.8389 

+ 1.0 

0.8413 

0.8438 

0.8461 

0.8485 

0.8508 

0.8531 

0.8554 

0.8577 

0.8599 

0.8621 

+1.1 

0.8643 

0.8665 

0.8686 

0.8708 

0.8729 

0.8749 

0.8770 

0.8790 

0.8810 

0.8830 

+ 1.2 

0.8849 

0.8869 

0.8888 

0.8907 

0.8925 

0.8944 

0.8962 

0.8980 

0.8997 

0.9015 

+ 1.3 

0.9032 

0.9049 

0.9066 

0.9082 

0.9099 

0.9115 

0.9131 

0.9147 

0.9162 

0.9177 

+ 1.4 

0.9192 

0.9207 

0.9222 

0.9236 

0.9251 

0.9265 

0.9279 

0.9292 

0.9306 

0.9319 

+ 1.5 

0.9332 

0.9345 

0.9357 

0.9370 

0.9382 

0.9394 

0.9406 

0.9418 

0.9429 

0.9441 

+ 1.6 

0.9452 

0.9463 

0.9474 

0.9484 

0.9495 

0.9505 

0.9515 

0.9525 

0.9535 

0.9545 

+ 1.7 

0.9554 

0.9564 

0.9573 

0.9582 

0.9591 

0.9599 

0.9608 

0.9616 

0.9625 

0.9633 

+ 1.8 

0.9641 

0.9646 

0.9656 

0.9664 

0.9671 

0.9678 

0.9686 

0.9693 

0.9699 

0.9706 

+ 1.9 

0.9713 

0.9719 

0.9726 

0.9732 

0.9738 

0.9744 

0.9750 

0.9756 

0.9761 

0.9767 

+2.0 

0.9773 

0.9778 

0.9783 

0.9788 

0.9793 

0.9798 

0.9803 

0.9808 

0.9812 

0.9817 

+ 2.1 

0.9821 

0.9826 

0.9830 

0.9834 

0.9838 

0.9842 

0.9846 

0.9850 

0.9854 

0.9857 

+ 2.2 

0.9861 

0.9864 

0.9868 

0.9871 

0.9875 

0.9878 

0.9881 

0.9884 

0.9887 

0.9890 

+ 2.3 

0.9893 

0.9896 

0.9898 
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